00000001:02000400:0.0F:1783135211.713285:0:2962:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1783135232.134182:0:3187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1783135234.441159:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 622 MB/s 00000001:01000000:3.0F:1783135234.691198:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 811 MB/s 00000001:01000000:3.0:1783135234.941617:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3719 MB/s 00000020:02000000:2.0:1783135235.809773:0:3279:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_84_g3203d2f 00000400:02000000:3.0:1783135237.026327:0:3294:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.201.160@tcp [8/256/0/180] 00008000:02000000:2.0:1783135240.640789:0:3444:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1783135292.967140:0:5247:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783135302.532506:0:5776:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135302.532511:0:5776:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783135302.532652:0:5776:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000005c9142e9 00000080:02000400:3.0:1783135302.532663:0:5776:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1783135302.537873:0:5776:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1783135302.537889:0:5776:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783135302.537929:0:5776:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000010683ff) 00000020:00000080:3.0:1783135302.538015:0:5776:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783135302.556596:0:5776:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1783135302.557348:0:5776:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783135302.585370:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783135302.585414:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783135302.585433:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783135302.585552:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783135302.585574:0:5776:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783135302.590561:0:5776:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783135302.590571:0:5776:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783135302.590583:0:5776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875c5ae 00000020:01000004:2.0:1783135302.590592:0:5776:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783135302.590599:0:5776:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783135302.590603:0:5776:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005c9142e9 from MGS 00000020:01000004:2.0:1783135302.590608:0:5776:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783135302.590639:0:5776:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000066c86457) 00000020:00000080:2.0:1783135302.590652:0:5776:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783135302.590722:0:5776:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005c9142e9 from MGS, refs=2 00080000:01000000:2.0:1783135302.590728:0:5776:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783135302.590807:0:5776:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875c5bc 00000100:00100000:2.0:1783135302.591087:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1783135302.591349:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1783135302.591356:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1783135302.595703:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1783135302.595716:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783135302.597402:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135302.599621:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783135302.599647:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783135302.602051:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783135302.602068:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1783135302.602809:0:5776:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1783135302.602843:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783135302.603694:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135302.603698:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135302.603700:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135302.606081:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135302.606087:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135302.606758:0:5776:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0F:1783135302.611857:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135302.615184:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1783135302.856279:0:5776:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2443 MB/s 00000001:01000000:3.0:1783135303.105899:0:5776:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3959 MB/s 00000001:01000000:2.0:1783135303.359090:0:5776:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 517 MB/s 00000001:01000000:1.0:1783135303.617142:0:5776:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 569 MB/s 00010000:00010000:1.0:1783135303.617629:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1783135303.633995:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1783135303.656082:0:5776:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1783135303.656098:0:5776:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783135303.656101:0:5776:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1783135303.657094:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1783135303.657153:0:5776:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1783135303.657207:0:5776:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1783135303.657580:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1783135303.657620:0:5776:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1783135303.662117:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135303.662303:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1783135303.662309:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1783135303.663351:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1783135303.663360:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1783135303.664367:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783135303.664375:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783135303.665267:0:5776:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783135303.665292:0:5776:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.160@tcp' 00000020:01000004:3.0:1783135303.665298:0:5776:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783135303.665375:0:5776:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.160@tcp (typ=mgc) 00000020:00000080:3.0:1783135303.665387:0:5776:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.160@tcp (00000000b1e8eb2d) 00000100:00080000:1.0:1783135303.665789:0:5790:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1783135303.666012:0:5776:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783135303.666101:0:5776:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000ab8fb9ae@MGC192.168.201.160@tcp: add connection 192.168.201.160@tcp at head 00010000:00010000:3.0:1783135303.666261:0:5776:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.160@tcp-0 is initialized 00000040:01000000:3.0:1783135303.666268:0:5776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.160@tcp ctxt 1 is initialized 10000000:01000000:3.0:1783135303.668007:0:5791:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1783135303.668092:0:5776:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.160@tcp (uuid b7b3a5dd-de38-42b7-b490-f49d65d3ab7a) 00000020:00000080:1.0:1783135303.668114:0:5776:0:(genops.c:1406:class_connect()) connect: client b7b3a5dd-de38-42b7-b490-f49d65d3ab7a, cookie 0xf646e0cda875c5ca 00000100:00080000:1.0:1783135303.668126:0:5776:0:(import.c:512:import_select_connection()) MGC192.168.201.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135303.668132:0:5776:0:(import.c:626:import_select_connection()) MGC192.168.201.160@tcp: import 00000000ab8fb9ae using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135303.668176:0:5776:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000dde6506 x1869752813224064/t0(0) o250->MGC192.168.201.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135303.668204:0:5776:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS 00000020:01000004:1.0:1783135303.668226:0:5776:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1783135303.668231:0:5776:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1783135303.668251:0:5776:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000b98e586a) 00000020:00000080:1.0:1783135303.668270:0:5776:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783135303.668698:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000dde6506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3310:1869752813224064:0@lo:250: 00000100:00100000:3.0:1783135303.668796:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135303.668882:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813224064 00000100:00100000:3.0:1783135303.668888:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813224064 00000100:00100000:3.0:1783135303.668930:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135303.668935:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043e06b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1869752813224064:12345-0@lo:250: 00010000:00080000:3.0:1783135303.668956:0:5787:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from b7b3a5dd-de38-42b7-b490-f49d65d3ab7a@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:3.0:1783135303.668978:0:5787:0:(genops.c:1406:class_connect()) connect: client b7b3a5dd-de38-42b7-b490-f49d65d3ab7a, cookie 0xf646e0cda875c5d8 00000100:00080000:3.0:1783135303.669111:0:5787:0:(import.c:65:import_set_state_nolock()) 0000000059af48e5 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135303.669157:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043e06b8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:3310:x1869752813224064:12345-0@lo:250: Request processed in 220us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135303.669164:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135303.669196:0:3310:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783135303.669203:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.160@tcp: connect to target with instance 0 00000100:00080000:3.0:1783135303.669210:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783135303.669213:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783135303.669217:0:3310:0:(import.c:65:import_set_state_nolock()) 00000000ab8fb9ae MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783135303.669219:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783135303.669226:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783135303.669231:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000dde6506 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3310:1869752813224064:0@lo:250: 00000100:00100000:1.0:1783135303.701215:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135303.701371:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1783135303.701376:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783135303.709308:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783135303.709338:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1783135303.709851:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1783135303.709859:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783135303.710805:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135303.711015:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783135303.711020:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783135303.711896:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783135303.711904:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1783135303.762360:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135303.763121:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1783135303.763128:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783135303.770098:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783135303.770113:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783135303.770873:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135303.771049:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783135303.771054:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783135303.771785:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783135303.771793:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1783135303.779788:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135303.780022:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783135303.780029:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783135303.780585:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783135303.780592:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783135303.781154:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135303.781316:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783135303.781328:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1783135303.787564:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783135303.787585:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1783135303.842508:0:5776:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135303.842716:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783135303.842733:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1783135303.852086:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783135303.852100:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1783135303.856334:0:5776:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135303.856347:0:5776:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783135303.858945:0:5776:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783135303.858976:0:5776:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783135303.858981:0:5776:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783135303.859098:0:5776:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135303.859134:0:5776:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.160@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1783135303.859138:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135303.859140:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135303.859141:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135303.859142:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135303.859143:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135303.859145:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135303.859146:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135303.859147:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135303.859149:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783135303.859150:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783135303.859151:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135303.859155:0:5776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135303.859157:0:5776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1783135303.859159:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135303.859160:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135303.859161:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135303.859162:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135303.859163:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135303.859164:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135303.859165:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135303.859166:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135303.859167:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783135303.859168:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783135303.859168:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135303.859169:0:5776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135303.859201:0:5776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783135303.859218:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000e085636 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224192:0@lo:253: 00000100:00100000:2.0:1783135303.859299:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135303.859396:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 000000002d459861 going to sleep for 11 seconds 00000100:00100000:1.0:1783135303.869230:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813224192 00000100:00100000:1.0:1783135303.869248:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813224192 00000100:00100000:1.0:1783135303.869326:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135303.869335:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014cd86e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:5776:x1869752813224192:12345-0@lo:253: 20000000:01000000:1.0:1783135303.869389:0:5789:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783135303.869393:0:5789:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:0.0:1783135303.870723:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1783135303.870804:0:5789:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1783135303.871128:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135303.874034:0:5811:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:2.0:1783135303.879782:0:5789:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1783135303.879791:0:5789:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:2.0:1783135303.879798:0:5789:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:2.0:1783135303.879802:0:5789:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:2.0:1783135303.880038:0:5789:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:2.0:1783135303.880315:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135303.880883:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:2.0:1783135303.880899:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1783135303.880951:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:2.0:1783135303.881000:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:2.0:1783135303.881039:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:2.0:1783135303.881131:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:2.0:1783135303.881139:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:2.0:1783135303.881193:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:2.0:1783135303.881201:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:2.0:1783135303.881230:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:2.0:1783135303.881237:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:2.0:1783135303.881274:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:2.0:1783135303.881321:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:2.0:1783135303.881352:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1783135303.881357:0:5789:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:2.0:1783135303.881370:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135303.881780:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1783135303.881792:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783135303.882010:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1783135303.882049:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1783135303.882098:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1783135303.882110:0:5789:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1783135303.882184:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1783135303.882192:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1783135303.882232:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1783135303.882279:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1783135303.882310:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1783135303.882319:0:5789:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1783135303.882393:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1783135303.882417:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1783135303.882451:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1783135303.882490:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1783135303.882661:0:5789:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1783135303.882710:0:5789:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1783135303.882718:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783135303.888636:0:5812:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1783135303.890213:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1783135303.890242:0:5789:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.160@tcp for mdt 20000000:01000000:0.0:1783135303.890244:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.160@tcp (null) (null) (null) 00000040:00080000:0.0:1783135303.890280:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1783135303.890288:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783135303.890321:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1783135303.890329:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.160@tcp (null) (null) 00000040:00080000:0.0:1783135303.890376:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1783135303.890388:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1783135303.890437:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1783135303.890472:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1783135303.890541:0:5789:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783135303.890546:0:5789:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783135303.890553:0:5789:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783135303.890562:0:5789:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1783135303.891287:0:5813:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:2.0:1783135303.891458:0:5789:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1783135303.905174:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1783135303.905234:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1783135303.905310:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1783135303.905330:0:5789:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783135303.905333:0:5789:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783135303.905336:0:5789:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783135303.905352:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783135303.905354:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783135303.905387:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783135303.905390:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783135303.906261:0:5814:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1783135303.910646:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1783135303.910745:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1783135303.910786:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1783135303.910806:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783135303.910809:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783135303.912673:0:5815:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1783135303.913107:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1783135303.913155:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1783135303.913228:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1783135303.913243:0:5789:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783135303.913245:0:5789:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1783135303.913254:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783135303.913276:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913302:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913314:0:5789:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913319:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913325:0:5789:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913330:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913336:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000639d5153 already unused, calling callback (000000000bbbada6) 00010000:00010000:3.0:1783135303.913340:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913347:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913358:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913365:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135303.913371:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000639d5153/0xf646e0cda875c5df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783135303.913413:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783135304.117334:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014cd86e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:5776:x1869752813224192:12345-0@lo:253: Request processed in 247992us (258028us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135304.117364:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135304.117474:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000e085636 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224192:0@lo:253: 10000000:01000000:2.0:1783135304.117501:0:5776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783135304.117503:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135304.117505:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135304.117513:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135304.117515:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1783135304.117516:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135304.117517:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135304.117518:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135304.117520:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135304.117521:0:5776:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1783135304.117523:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135304.117524:0:5776:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783135304.117778:0:5776:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005c9142e9 from lustre-MDT0000 10000000:01000000:2.0:1783135304.117804:0:5776:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783135304.117806:0:5776:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783135304.117811:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e8f062a19c0 10000000:01000000:2.0:1783135304.117835:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135304.117844:0:5776:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8f062a19c0 from 1 10000000:01000000:2.0:1783135304.117847:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783135304.117886:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: 000000005f5baa52/0xf646e0cda875c5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.117897:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: 000000005f5baa52/0xf646e0cda875c5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.117915:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: 000000005f5baa52/0xf646e0cda875c5e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135304.117933:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000e085636 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224320:0@lo:101: 00000100:00100000:2.0:1783135304.117969:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135304.118069:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 000000005bd268ac going to sleep for 11 seconds 00000100:00100000:0.0:1783135304.118202:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813224320 00000100:00100000:0.0:1783135304.118209:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813224320 00000100:00100000:0.0:1783135304.118268:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135304.118277:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0c7e485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:5776:x1869752813224320:12345-0@lo:101: 00010000:00010000:0.0:1783135304.118292:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135304.118305:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007f4cb877/0xf646e0cda875c5ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c5e6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.118328:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007f4cb877/0xf646e0cda875c5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.118337:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007f4cb877/0xf646e0cda875c5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 6 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.118345:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007f4cb877, rc 0) 00000100:00100000:0.0:1783135304.118381:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0c7e485 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+6:5776:x1869752813224320:12345-0@lo:101: Request processed in 107us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135304.118388:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135304.118781:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000e085636 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224320:0@lo:101: 00010000:00010000:2.0:1783135304.118795:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: 000000005f5baa52/0xf646e0cda875c5e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.118803:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: 000000005f5baa52/0xf646e0cda875c5e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135304.118897:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000000e085636 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224448:0@lo:501: 00000100:00100000:2.0:1783135304.118938:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135304.118957:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 000000005bd268ac going to sleep for 11 seconds 00000100:00100000:0.0:1783135304.119074:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813224448 00000100:00100000:0.0:1783135304.119080:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813224448 00000100:00100000:0.0:1783135304.119115:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135304.119122:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000577becb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+6:5776:x1869752813224448:12345-0@lo:501: 00000100:00100000:0.0:1783135304.119408:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000577becb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+6:5776:x1869752813224448:12345-0@lo:501: Request processed in 286us (469us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135304.119415:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135304.119986:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000000e085636 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224448:0@lo:501: 10000000:01000000:1.0:1783135304.120019:0:5776:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783135304.120069:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: 000000005f5baa52/0xf646e0cda875c5e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.120079:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: 000000005f5baa52/0xf646e0cda875c5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135304.120087:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8f063e9800 10000000:01000000:1.0:1783135304.120092:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783135304.120096:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e8f063e9800 10000000:01000000:1.0:1783135304.120098:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1783135304.120101:0:5776:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8e8f063e9800 from 1 10000000:01000000:1.0:1783135304.120104:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1783135304.120126:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: 000000001f5ab224/0xf646e0cda875c5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.120132:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: 000000001f5ab224/0xf646e0cda875c5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.120140:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: 000000001f5ab224/0xf646e0cda875c5f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135304.120153:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dc6d52cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224576:0@lo:101: 00000100:00100000:1.0:1783135304.120200:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.120240:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a3a1843b going to sleep for 11 seconds 00000100:00100000:2.0:1783135304.120301:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813224576 00000100:00100000:2.0:1783135304.120306:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813224576 00000100:00100000:2.0:1783135304.120339:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135304.120346:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b68d9090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+6:5776:x1869752813224576:12345-0@lo:101: 00010000:00010000:2.0:1783135304.120356:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135304.120367:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000351cd24e/0xf646e0cda875c5fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c5f4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.120382:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000351cd24e/0xf646e0cda875c5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c5f4 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.120390:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000351cd24e/0xf646e0cda875c5fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c5f4 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.120398:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000351cd24e, rc 0) 00000100:00100000:2.0:1783135304.120432:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b68d9090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+7:5776:x1869752813224576:12345-0@lo:101: Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135304.120438:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135304.120625:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dc6d52cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224576:0@lo:101: 00010000:00010000:1.0:1783135304.120777:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: 000000001f5ab224/0xf646e0cda875c5f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.120796:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: 000000001f5ab224/0xf646e0cda875c5f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135304.120808:0:5776:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1783135304.121424:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: 000000001f5ab224/0xf646e0cda875c5f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.121433:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: 000000001f5ab224/0xf646e0cda875c5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135304.121440:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1783135304.121445:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135304.121451:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e8f063e9800 10000000:01000000:1.0:1783135304.121453:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1783135304.121456:0:5776:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1783135304.121458:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783135304.121802:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: 0000000036c46444/0xf646e0cda875c602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.121810:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: 0000000036c46444/0xf646e0cda875c602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.121895:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: 0000000036c46444/0xf646e0cda875c602 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135304.121962:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000dc6d52cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224704:0@lo:101: 00000100:00100000:1.0:1783135304.122012:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.122091:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a3a1843b going to sleep for 11 seconds 00000100:00100000:2.0:1783135304.122144:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813224704 00000100:00100000:2.0:1783135304.122151:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813224704 00000100:00100000:2.0:1783135304.122235:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135304.122244:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020817e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+7:5776:x1869752813224704:12345-0@lo:101: 00010000:00010000:2.0:1783135304.122256:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135304.122266:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f4770a57/0xf646e0cda875c609 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c602 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.122289:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f4770a57/0xf646e0cda875c609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c602 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.122297:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f4770a57/0xf646e0cda875c609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c602 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.122305:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f4770a57, rc 0) 00000100:00100000:2.0:1783135304.122346:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020817e52 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+8:5776:x1869752813224704:12345-0@lo:101: Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135304.122352:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135304.122426:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000dc6d52cb pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224704:0@lo:101: 00010000:00010000:3.0:1783135304.122439:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: 0000000036c46444/0xf646e0cda875c602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135304.122446:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: 0000000036c46444/0xf646e0cda875c602 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135304.122524:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224832:0@lo:501: 00000100:00100000:3.0:1783135304.122741:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135304.123005:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 0000000049d99c25 going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.123096:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813224832 00000100:00100000:1.0:1783135304.123100:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813224832 00000100:00100000:1.0:1783135304.123124:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135304.123130:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007815792d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+8:5776:x1869752813224832:12345-0@lo:501: 00000100:00100000:1.0:1783135304.123387:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007815792d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:5776:x1869752813224832:12345-0@lo:501: Request processed in 256us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.123395:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135304.123487:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224832:0@lo:501: 00000100:00100000:3.0:1783135304.123516:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224960:0@lo:503: 00000100:00100000:3.0:1783135304.123566:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135304.123588:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 0000000049d99c25 going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.124073:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813224960 00000100:00100000:1.0:1783135304.124078:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813224960 00000100:00100000:1.0:1783135304.124103:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135304.124109:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2d93154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:5776:x1869752813224960:12345-0@lo:503: 00000100:00100000:1.0:1783135304.124275:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2d93154 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:5776:x1869752813224960:12345-0@lo:503: Request processed in 166us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.124282:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135304.124447:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813224960:0@lo:503: 00000100:00100000:3.0:1783135304.125092:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5818:1869752813225088:0@lo:502: 00000100:00100000:3.0:1783135304.125132:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135304.125167:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set 00000000963bace7 going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.125290:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813225088 00000100:00100000:1.0:1783135304.125296:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813225088 00000100:00100000:1.0:1783135304.125321:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783135304.125327:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0b622ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:5818:x1869752813225088:12345-0@lo:502: 00000100:00100000:1.0:1783135304.125543:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0b622ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:5818:x1869752813225088:12345-0@lo:502: Request processed in 216us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.125550:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135304.126012:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5818:1869752813225088:0@lo:502: 00000020:01000000:2.0:1783135304.126112:0:5818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135304.126124:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135304.126126:0:5818:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783135304.126132:0:5818:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783135304.126135:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135304.126148:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005b02cdcf) 00000020:00000080:2.0:1783135304.126164:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783135304.126169:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783135304.126236:0:5818:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783135304.126243:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875c617 00000020:00000080:2.0:1783135304.126457:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783135304.126462:0:5818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135304.126528:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135304.126594:0:5818:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783135304.126599:0:5818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135304.126615:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135304.126617:0:5818:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783135304.126621:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135304.126705:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000061e6f876) 00000020:00000080:2.0:1783135304.126720:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783135304.126737:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783135304.126739:0:5818:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783135304.126742:0:5818:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783135304.126748:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135304.126797:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005c9142e9 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783135304.126810:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000c12fa650) 00000020:00000080:2.0:1783135304.126843:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783135304.126985:0:5818:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783135304.126991:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875c62c 00000020:00000080:2.0:1783135304.127093:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783135304.127100:0:5818:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783135304.127104:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf646e0cda875c633 00080000:01000000:2.0:1783135304.127109:0:5818:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783135304.127113:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875c63a 00080000:10000000:2.0:1783135304.127711:0:5818:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1783135304.130202:0:5818:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1783135304.148378:0:5818:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1783135304.251904:0:5818:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1783135304.252265:0:5818:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1783135304.256393:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1783135304.256733:0:5818:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1783135304.301287:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000004a166645) 00000020:00000080:2.0:1783135304.301313:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1783135304.301402:0:5818:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1783135304.301410:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875c648 00000020:00000080:3.0:1783135304.305330:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1783135304.306688:0:5818:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135304.355667:0:5818:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135304.394726:0:5818:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783135304.421057:0:5818:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135304.459674:0:5818:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783135304.508110:0:5818:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1783135304.546266:0:5818:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf646e0cda875c64f 00000020:00000080:2.0:1783135304.546640:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783135304.546651:0:5818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135304.546656:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135304.546658:0:5818:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783135304.546661:0:5818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135304.546667:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135304.546688:0:5818:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783135304.546693:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783135304.546729:0:5818:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783135304.546742:0:5818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135304.546745:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135304.546746:0:5818:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783135304.546748:0:5818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135304.546751:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135304.546752:0:5818:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783135304.546755:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783135304.546757:0:5818:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783135304.546797:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003de8f9bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5818:1869752813225216:0@lo:502: 00000100:00100000:2.0:1783135304.547012:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135304.547177:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set 00000000fe74c92b going to sleep for 11 seconds 00000100:00100000:3.0:1783135304.547562:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813225216 00000100:00100000:3.0:1783135304.547571:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813225216 00000100:00100000:3.0:1783135304.547685:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135304.547694:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e47fc6c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:5818:x1869752813225216:12345-0@lo:502: 00000100:00100000:3.0:1783135304.548506:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e47fc6c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:5818:x1869752813225216:12345-0@lo:502: Request processed in 810us (1491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135304.548516:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135304.548605:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003de8f9bd pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5818:1869752813225216:0@lo:502: 00000020:01000000:0.0:1783135304.548643:0:5818:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135304.548650:0:5818:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135304.548653:0:5818:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783135304.548657:0:5818:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1783135304.548848:0:5776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1783135304.548868:0:5776:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783135304.548885:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: 0000000036c46444/0xf646e0cda875c602 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.548918:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: 0000000036c46444/0xf646e0cda875c602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135304.548926:0:5776:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e8f063e9800 from 1 10000000:01000000:1.0:1783135304.548929:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135304.548960:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.548968:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.548977:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135304.548993:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225344:0@lo:101: 00000100:00100000:1.0:1783135304.549029:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.549273:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b77c94df going to sleep for 11 seconds 00000100:00100000:2.0:1783135304.549341:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813225344 00000100:00100000:2.0:1783135304.549347:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813225344 00000100:00100000:2.0:1783135304.549375:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135304.549383:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ecd7b97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:5776:x1869752813225344:12345-0@lo:101: 00010000:00010000:2.0:1783135304.549394:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135304.549406:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c656 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.549426:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c656 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.549435:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c656 expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.549443:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000098a5c3b9, rc 0) 00000100:00100000:2.0:1783135304.549480:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ecd7b97 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:5776:x1869752813225344:12345-0@lo:101: Request processed in 98us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135304.549494:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783135304.549564:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225344:0@lo:101: 00010000:00010000:1.0:1783135304.549576:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.549583:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135304.550291:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225472:0@lo:256: 00000100:00100000:1.0:1783135304.550334:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.550348:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b77c94df going to sleep for 11 seconds 00000100:00100000:3.0:1783135304.550425:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813225472 00000100:00100000:3.0:1783135304.550431:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813225472 00000100:00100000:3.0:1783135304.550459:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135304.550466:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000041c18eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:5776:x1869752813225472:12345-0@lo:256: 20000000:01000000:3.0:1783135304.550481:0:5787:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1783135304.550486:0:5787:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1783135304.550543:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000041c18eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:5776:x1869752813225472:12345-0@lo:256: Request processed in 78us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135304.550550:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135304.550733:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225472:0@lo:256: 10000000:01000000:1.0:1783135304.551413:0:5776:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135304.551475:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.551487:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135304.551495:0:5776:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f063e9800 from 1 10000000:01000000:1.0:1783135304.551497:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135304.551521:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.551529:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.551537:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135304.551551:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225600:0@lo:101: 00000100:00100000:1.0:1783135304.551589:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.551631:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b77c94df going to sleep for 11 seconds 00000100:00100000:3.0:1783135304.551698:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813225600 00000100:00100000:3.0:1783135304.551703:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813225600 00000100:00100000:3.0:1783135304.551743:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135304.551750:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d15fbc7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:5776:x1869752813225600:12345-0@lo:101: 00010000:00010000:3.0:1783135304.551760:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135304.551772:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c664 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135304.551789:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c664 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135304.551798:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c664 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135304.551831:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003da5da6b, rc 0) 00000100:00100000:3.0:1783135304.551869:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d15fbc7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5776:x1869752813225600:12345-0@lo:101: Request processed in 120us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135304.551876:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135304.551999:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225600:0@lo:101: 00010000:00010000:1.0:1783135304.552009:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.552017:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135304.552075:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225728:0@lo:501: 00000100:00100000:1.0:1783135304.552099:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.552121:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b77c94df going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.552134:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813225728 00000100:00100000:1.0:1783135304.552138:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813225728 00000100:00100000:1.0:1783135304.552228:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135304.552235:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032e12158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5776:x1869752813225728:12345-0@lo:501: 00000100:00100000:1.0:1783135304.552797:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032e12158 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5776:x1869752813225728:12345-0@lo:501: Request processed in 562us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.552805:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135304.553167:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225728:0@lo:501: 00000100:00100000:1.0:1783135304.553200:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225856:0@lo:503: 00000100:00100000:1.0:1783135304.553244:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.553317:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000b77c94df going to sleep for 11 seconds 00000100:00100000:3.0:1783135304.553351:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813225856 00000100:00100000:3.0:1783135304.553356:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813225856 00000100:00100000:3.0:1783135304.553423:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135304.553430:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b975cfee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5776:x1869752813225856:12345-0@lo:503: 00000040:00080000:3.0:1783135304.553467:0:5787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135304.553517:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b975cfee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5776:x1869752813225856:12345-0@lo:503: Request processed in 87us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135304.553523:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135304.553631:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000098a31fb0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225856:0@lo:503: 00000040:00080000:1.0:1783135304.555424:0:5822:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1783135304.555630:0:5776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1783135304.555656:0:5776:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135304.555787:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.555800:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135304.555876:0:5776:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135304.555880:0:5776:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8f063e9800 10000000:01000000:2.0:1783135304.555883:0:5776:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8f063e9800 10000000:01000000:2.0:1783135304.555887:0:5776:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135304.555893:0:5776:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f063e9800 from 1 10000000:01000000:2.0:1783135304.555907:0:5776:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135304.555940:0:5776:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: 00000000c8f2897a/0xf646e0cda875c672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.555947:0:5776:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: 00000000c8f2897a/0xf646e0cda875c672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.555956:0:5776:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: 00000000c8f2897a/0xf646e0cda875c672 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135304.555975:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000007a0ef71b pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225984:0@lo:101: 00000100:00100000:2.0:1783135304.556035:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135304.556069:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000c79c968c going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.556194:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813225984 00000100:00100000:1.0:1783135304.556200:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813225984 00000100:00100000:1.0:1783135304.556247:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135304.556254:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c85aa161 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5776:x1869752813225984:12345-0@lo:101: 00010000:00010000:1.0:1783135304.556268:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135304.556281:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ab101d17/0xf646e0cda875c679 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c672 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.556303:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ab101d17/0xf646e0cda875c679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c672 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.556326:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ab101d17/0xf646e0cda875c679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c672 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.556334:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ab101d17, rc 0) 00000100:00100000:1.0:1783135304.556373:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c85aa161 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5776:x1869752813225984:12345-0@lo:101: Request processed in 120us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.556379:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135304.556420:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000007a0ef71b pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813225984:0@lo:101: 00010000:00010000:1.0:1783135304.556432:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: 00000000c8f2897a/0xf646e0cda875c672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.556439:0:5776:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: 00000000c8f2897a/0xf646e0cda875c672 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135304.556483:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000032fd31d pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813226112:0@lo:501: 00000100:00100000:1.0:1783135304.556507:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.556518:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a5d4ada2 going to sleep for 11 seconds 00000100:00100000:2.0:1783135304.556632:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813226112 00000100:00100000:2.0:1783135304.556636:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813226112 00000100:00100000:2.0:1783135304.556670:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135304.556790:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006d4e8e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5776:x1869752813226112:12345-0@lo:501: 00000100:00100000:2.0:1783135304.557100:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006d4e8e7c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5776:x1869752813226112:12345-0@lo:501: Request processed in 312us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135304.557162:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000032fd31d pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813226112:0@lo:501: 00000100:00100000:0.0:1783135304.557207:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000001d7b57c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813226240:0@lo:503: 00000100:00100000:0.0:1783135304.557244:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135304.557260:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 0000000013cdd01e going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.557418:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813226240 00000100:00100000:1.0:1783135304.557422:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813226240 00000100:00100000:1.0:1783135304.557442:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135304.557449:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016723416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5776:x1869752813226240:12345-0@lo:503: 00000100:00100000:1.0:1783135304.558030:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016723416 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5776:x1869752813226240:12345-0@lo:503: Request processed in 580us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.558039:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135304.558116:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783135304.558179:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000001d7b57c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813226240:0@lo:503: 00000100:00100000:2.0:1783135304.558552:0:5823:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000baae46fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5823:1869752813226368:0@lo:502: 00000100:00100000:2.0:1783135304.558593:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135304.558669:0:5823:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e8efe64f going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.559113:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813226368 00000100:00100000:1.0:1783135304.559119:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813226368 00000100:00100000:1.0:1783135304.559205:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135304.559214:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005d84518d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5823:x1869752813226368:12345-0@lo:502: 00000100:00100000:1.0:1783135304.559473:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005d84518d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5823:x1869752813226368:12345-0@lo:502: Request processed in 260us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.559481:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783135304.559568:0:5823:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000baae46fb pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5823:1869752813226368:0@lo:502: 00000020:01000004:3.0:1783135304.559634:0:5823:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783135304.559648:0:5823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000000f1f42a5) 00000020:00000080:3.0:1783135304.559666:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1783135304.559884:0:5823:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005c9142e9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783135304.559888:0:5823:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005c9142e9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783135304.559891:0:5823:0:(obd_mount.c:701:lustre_put_lsi()) put 000000005c9142e9 4 00010000:00080000:3.0:1783135304.560083:0:5823:0:(ldlm_lib.c:102:import_set_conn()) imp 000000001dbb2c0f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.160@tcp at head 00010000:00010000:3.0:1783135304.562731:0:5823:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1783135304.562876:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783135304.564021:0:5823:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135304.564037:0:5823:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf646e0cda875c687 00000100:00080000:3.0:1783135304.564048:0:5823:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135304.564053:0:5823:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001dbb2c0f using connection 192.168.201.160@tcp/0@lo 00000100:00100000:3.0:1783135304.564093:0:5823:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e5b99098 x1869752813226496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135304.564118:0:5823:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783135304.564351:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813226496:0@lo:38: 00000100:00100000:0.0:1783135304.564424:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135304.564533:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813226496 00000100:00100000:1.0:1783135304.564540:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813226496 00000100:00100000:3.0:1783135304.564690:0:5823:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000004e6631c1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5823:1869752813226624:0@lo:502: 00000100:00100000:3.0:1783135304.564732:0:5823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135304.564755:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813226624 00000100:00100000:3.0:1783135304.564758:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813226624 00000100:00100000:3.0:1783135304.564788:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135304.564794:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9171ddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5823:x1869752813226624:12345-0@lo:502: 00000100:00100000:3.0:1783135304.565100:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9171ddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5823:x1869752813226624:12345-0@lo:502: Request processed in 304us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135304.565107:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783135304.565145:0:5823:0:(client.c:2701:ptlrpc_set_wait()) set 000000003585c722 going to sleep for 11 seconds 00000100:00100000:3.0:1783135304.565166:0:5823:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000004e6631c1 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5823:1869752813226624:0@lo:502: 00000040:00080000:3.0:1783135304.565188:0:5823:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:1.0:1783135304.565348:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135304.565353:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d7b57c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1869752813226496:12345-0@lo:38: 00000100:00100000:1.0:1783135304.565408:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d7b57c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1869752813226496:12345-0@lo:38: Request processed in 54us (985us total) trans 0 rc -11/-11 00000100:00100000:1.0:1783135304.565415:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135304.565471:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135304.565478:0:3310:0:(import.c:65:import_set_state_nolock()) 000000001dbb2c0f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135304.565482:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783135304.565485:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813226496:0@lo:38: 00000020:01000000:0.0:1783135304.565567:0:5776:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1783135304.565591:0:5776:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135304.565621:0:5776:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: 00000000c8f2897a/0xf646e0cda875c672 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.565630:0:5776:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: 00000000c8f2897a/0xf646e0cda875c672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1783135304.565673:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1783135304.565676:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783135304.565677:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135304.565678:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135304.565680:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135304.565681:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135304.565682:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783135304.565684:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783135304.565685:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783135304.565690:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783135304.565691:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135304.565692:0:5776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783135304.565695:0:5776:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1783135304.565697:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783135304.565698:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783135304.565699:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135304.565700:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135304.565701:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135304.565702:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135304.565703:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783135304.565704:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783135304.565705:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783135304.565705:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783135304.565706:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135304.565707:0:5776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1783135304.565721:0:5776:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783135304.565730:0:5776:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000193ac84c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813226752:0@lo:253: 00000100:00100000:0.0:1783135304.565761:0:5776:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135304.565782:0:5776:0:(client.c:2701:ptlrpc_set_wait()) set 0000000013cdd01e going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.566003:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813226752 00000100:00100000:1.0:1783135304.566009:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813226752 00000100:00100000:1.0:1783135304.566072:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783135304.566079:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fee6913f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5776:x1869752813226752:12345-0@lo:253: 20000000:01000000:1.0:1783135304.566100:0:5789:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783135304.566112:0:5789:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1783135304.599448:0:5789:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783135304.599469:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783135304.599535:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783135304.599540:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783135304.599560:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.599578:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c656 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.599586:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.599636:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c656 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.599651:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c656 expref: 12 pid: 5788 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135304.599682:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000030c33ed5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869752813226880:0@lo:104: 00000100:00100000:0.0:1783135304.600039:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135304.600086:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set 000000007c16614e going to sleep for 11 seconds 00000100:00100000:1.0:1783135304.600164:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813226880 00000100:00100000:1.0:1783135304.600172:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813226880 00000100:00100000:1.0:1783135304.600230:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135304.600238:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a78544f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5810:x1869752813226880:12345-0@lo:104: 00010000:00010000:1.0:1783135304.600249:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.600296:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135304.600301:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a78544f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5810:x1869752813226880:12345-0@lo:104: Request processed in 65us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.600314:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135304.600398:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000030c33ed5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869752813226880:0@lo:104: 00010000:00010000:0.0:1783135304.600415:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.600665:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135304.600671:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.600679:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b39f6550 already unused, calling callback (0000000056e3f84d) 10000000:00010000:2.0:1783135304.600682:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.600689:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135304.600696:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135304.600701:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783135304.600738:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.600745:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135304.600771:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.600788:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: 00000000b39f6550/0xf646e0cda875c656 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c65d expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135304.600804:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135304.600806:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135304.600807:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135304.601146:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000c2f1a518 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813227008:0@lo:103: 00000100:00100000:1.0:1783135304.601182:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135304.601292:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813227008 00000100:00100000:0.0:1783135304.601297:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813227008 00010000:00010000:0.0:1783135304.601315:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c656 expref: 13 pid: 5788 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135304.601346:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135304.601353:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000741018bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:3312:x1869752813227008:12345-0@lo:103: 00010000:00010000:0.0:1783135304.601363:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135304.601368:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c656 expref: 13 pid: 5788 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601377:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c656 expref: 13 pid: 5788 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601390:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000098a5c3b9/0xf646e0cda875c65d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c656 expref: 13 pid: 5788 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601402:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601409:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783135304.601427:0:5780:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001887877s 00010000:00010000:0.0:1783135304.601430:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601437:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601442:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601448:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601454:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000469698ac already unused, calling callback (000000000bbbada6) 00010000:00010000:0.0:1783135304.601457:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601464:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601484:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135304.601493:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135304.601523:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000741018bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:3312:x1869752813227008:12345-0@lo:103: Request processed in 171us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135304.601530:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135304.601556:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000c2f1a518 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813227008:0@lo:103: 00010000:00010000:1.0:1783135304.601646:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.601654:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135304.601658:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000469698ac/0xf646e0cda875c68e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135304.610600:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fee6913f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5776:x1869752813226752:12345-0@lo:253: Request processed in 44507us (44823us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135304.610616:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135304.610731:0:5776:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000193ac84c pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5776:1869752813226752:0@lo:253: 10000000:01000000:2.0:1783135304.610747:0:5776:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783135304.610751:0:5776:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135304.610753:0:5776:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135304.610754:0:5776:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135304.610755:0:5776:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135304.610757:0:5776:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135304.610758:0:5776:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135304.610759:0:5776:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135304.610761:0:5776:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135304.610762:0:5776:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783135304.610764:0:5776:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783135304.610765:0:5776:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135304.610767:0:5776:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135304.610785:0:5776:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783135304.616290:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135304.616708:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135304.617128:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135304.617294:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135304.617485:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135304.617668:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135304.618695:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135304.619026:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135304.619262:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135304.619449:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135304.619652:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135304.619867:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:3.0:1783135304.636484:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:1.0:1783135304.665258:0:5776:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1783135304.696668:0:5776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1783135304.696999:0:5829:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:2.0:1783135304.705282:0:5828:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1783135304.705288:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783135304.707409:0:5776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783135304.708095:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783135304.708511:0:5776:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783135304.708519:0:5776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783135304.708660:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135304.709632:0:5776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783135304.710182:0:5776:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783135304.710231:0:5776:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783135304.710432:0:5776:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783135304.710626:0:5776:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1783135304.712557:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783135304.712696:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1783135304.712866:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1783135304.713445:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1783135304.713610:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1783135304.713745:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1783135304.715155:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1783135304.715336:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1783135304.715502:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1783135304.715647:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1783135304.716069:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1783135304.716229:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1783135304.716382:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1783135304.716514:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1783135304.716690:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1783135304.716848:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1783135304.717496:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1783135304.717647:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1783135304.717796:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1783135304.718064:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1783135304.718211:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1783135304.718352:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1783135304.718500:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1783135304.718646:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1783135304.718795:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783135304.719389:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783135304.719539:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783135304.719701:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783135304.720155:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783135304.720299:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1783135304.720456:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783135304.720611:0:5776:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783135304.721091:0:5776:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1783135304.753282:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1783135304.805652:0:5776:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783135304.805700:0:5776:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9c27418fb988 00100000:10000000:1.0:1783135304.805709:0:5776:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1783135304.809756:0:5776:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135304.809777:0:5776:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135304.809793:0:5776:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1783135304.809863:0:5776:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1783135304.859586:0:5829:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783135304.859676:0:5829:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783135304.859681:0:5829:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1783135305.662463:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135306.684982:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135307.709970:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135308.730061:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135309.580031:0:6072:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783135309.754784:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135309.947662:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783135309.947673:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135309.947676:0:38:0:(import.c:65:import_set_state_nolock()) 000000001dbb2c0f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135309.947694:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000001dbb2c0f using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135309.947726:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a53efec x1869752813227264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135309.947764:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a53efec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813227264:0@lo:38: 00000100:00100000:1.0:1783135309.948003:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135309.948374:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813227264 00000100:00100000:3.0:1783135309.948381:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813227264 00000100:00100000:3.0:1783135309.948415:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135309.948421:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c26d299 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1869752813227264:12345-0@lo:38: 00010000:00080000:3.0:1783135309.948447:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 209 last 0 00000020:00000080:3.0:1783135309.948649:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf646e0cda875c695 00000004:00100000:3.0:1783135309.948688:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1783135309.948871:0:5796:0:(import.c:65:import_set_state_nolock()) 000000008c937f3e : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135309.948937:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c26d299 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869752813227264:12345-0@lo:38: Request processed in 514us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135309.948945:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135309.949569:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000920bda56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813227136:0@lo:400: 00000100:00100000:0.0:1783135309.949618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135309.950426:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813227136 00000100:00100000:3.0:1783135309.950439:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813227136 00000100:00100000:3.0:1783135309.950477:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135309.950484:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c3626ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:3313:x1869752813227136:12345-0@lo:400: 00000100:00100000:3.0:1783135309.950551:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c3626ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:3313:x1869752813227136:12345-0@lo:400: Request processed in 68us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135309.950558:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135309.950609:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000920bda56 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813227136:0@lo:400: 00010000:00080000:1.0:1783135309.952696:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003a53efec x1869752813227264/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135309.952717:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783135309.952725:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783135309.952730:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783135309.952733:0:3310:0:(import.c:65:import_set_state_nolock()) 000000001dbb2c0f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135309.952739:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a53efec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813227264:0@lo:38: 00010000:00010000:3.0:1783135310.780057:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135311.803492:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783135311.993963:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135311.993972:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e8f063e9800 from 3 10000000:01000000:0.0:1783135311.993977:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135311.994026:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: 00000000837de02c/0xf646e0cda875c69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135311.994038:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: 00000000837de02c/0xf646e0cda875c69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135311.994049:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: 00000000837de02c/0xf646e0cda875c69c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135311.994073:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000030c33ed5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813227392:0@lo:101: 00000100:00100000:0.0:1783135311.994140:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135311.994204:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 0000000044849b54 going to sleep for 11 seconds 00000100:00100000:1.0:1783135311.994347:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813227392 00000100:00100000:1.0:1783135311.994354:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813227392 00000100:00100000:1.0:1783135311.994404:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135311.994411:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002eea9d18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5791:x1869752813227392:12345-0@lo:101: 00010000:00010000:1.0:1783135311.994424:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135311.994435:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb64fc54/0xf646e0cda875c6a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c69c expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135311.994455:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb64fc54/0xf646e0cda875c6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c69c expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135311.994464:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb64fc54/0xf646e0cda875c6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c69c expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135311.994482:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb64fc54, rc 0) 00000100:00100000:1.0:1783135311.994520:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002eea9d18 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813227392:12345-0@lo:101: Request processed in 110us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135311.994540:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783135311.994770:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000030c33ed5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813227392:0@lo:101: 00010000:00010000:0.0:1783135311.994783:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: 00000000837de02c/0xf646e0cda875c69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135311.994790:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: 00000000837de02c/0xf646e0cda875c69c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135311.994849:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000030c33ed5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813227520:0@lo:256: 00000100:00100000:0.0:1783135311.994876:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135311.994905:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 0000000044849b54 going to sleep for 11 seconds 00000100:00100000:3.0:1783135311.994963:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813227520 00000100:00100000:3.0:1783135311.994968:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813227520 00000100:00100000:3.0:1783135311.994996:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135311.995001:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000678c4ac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813227520:12345-0@lo:256: 20000000:01000000:3.0:1783135311.995014:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783135311.995027:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783135311.995030:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783135311.995098:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000678c4ac8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813227520:12345-0@lo:256: Request processed in 97us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135311.995104:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135311.995213:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000030c33ed5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813227520:0@lo:256: 10000000:01000000:2.0:1783135311.995249:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135311.995254:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: 00000000837de02c/0xf646e0cda875c69c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135311.995261:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: 00000000837de02c/0xf646e0cda875c69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135312.831315:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135313.851397:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783135314.870190:0:6273:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff02ba5cb0 20000000:00000080:3.0:1783135314.870207:0:6273:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8f3cf23c00 uarg=0000000000000000 20000000:01000000:3.0:1783135314.870238:0:6273:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1783135314.870244:0:6273:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1783135314.870250:0:6273:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1783135314.870441:0:6273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1783135314.870453:0:6273:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1783135314.877696:0:6273:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135314.877976:0:6273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783135314.878032:0:6273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1783135314.878079:0:6273:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1783135314.878096:0:6273:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1783135314.878112:0:6273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135314.878131:0:6273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c664 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135314.878147:0:6273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135314.878185:0:6273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c664 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135314.878198:0:6273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c664 expref: 11 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135314.878211:0:6273:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d30c71b7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6273:1869752813227648:0@lo:104: 00000100:00100000:2.0:1783135314.878272:0:6273:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135314.878330:0:6273:0:(client.c:2701:ptlrpc_set_wait()) set 000000002b22f146 going to sleep for 11 seconds 00010000:00010000:0.0:1783135314.879244:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135314.880004:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813227648 00000100:00100000:1.0:1783135314.880012:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813227648 00000100:00100000:1.0:1783135314.880066:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135314.880073:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ba0575d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:6273:x1869752813227648:12345-0@lo:104: 00010000:00010000:1.0:1783135314.880096:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135314.880211:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135314.880216:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ba0575d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:6273:x1869752813227648:12345-0@lo:104: Request processed in 143us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135314.880222:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783135314.880449:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135314.880454:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880474:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005d70f199 already unused, calling callback (0000000056e3f84d) 10000000:00010000:3.0:1783135314.880478:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880484:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135314.880491:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135314.880496:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783135314.880541:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880549:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135314.880570:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880576:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: 000000005d70f199/0xf646e0cda875c664 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c66b expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880594:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135314.880595:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135314.880596:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135314.880610:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813227776:0@lo:103: 00000100:00100000:3.0:1783135314.880647:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135314.880702:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813227776 00000100:00100000:3.0:1783135314.880706:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813227776 00010000:00010000:3.0:1783135314.880735:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c664 expref: 12 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135314.880771:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135314.880777:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e6631c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:3314:x1869752813227776:12345-0@lo:103: 00010000:00010000:3.0:1783135314.880786:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135314.880790:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c664 expref: 12 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880798:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c664 expref: 12 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880837:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880846:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880862:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880868:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880874:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880878:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880883:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e6249da already unused, calling callback (000000000bbbada6) 00010000:00010000:3.0:1783135314.880886:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880898:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880906:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135314.880916:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135314.880945:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e6631c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:3314:x1869752813227776:12345-0@lo:103: Request processed in 169us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135314.880951:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135314.880985:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e5b99098 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813227776:0@lo:103: 00010000:00010000:2.0:1783135314.881128:0:6273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003da5da6b/0xf646e0cda875c66b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c664 expref: 11 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135314.881140:0:6273:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d30c71b7 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6273:1869752813227648:0@lo:104: 00010000:00010000:2.0:1783135314.881152:0:6273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135314.881160:0:6273:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135314.881166:0:6273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135314.881171:0:6273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e6249da/0xf646e0cda875c6aa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135315.070840:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a53efec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813227904:0@lo:400: 00000100:00100000:1.0:1783135315.070908:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135315.070978:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813227904 00000100:00100000:1.0:1783135315.070986:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813227904 00000100:00100000:1.0:1783135315.071031:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135315.071041:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f71a58a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813227904:12345-0@lo:400: 00000100:00100000:1.0:1783135315.071090:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f71a58a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813227904:12345-0@lo:400: Request processed in 51us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135315.071097:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783135315.071135:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003a53efec x1869752813227904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135315.071149:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a53efec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813227904:0@lo:400: 00010000:00010000:0.0:1783135315.900955:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135316.923628:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135317.949118:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783135318.074983:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135318.075004:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f063e9800 from 1 10000000:01000000:2.0:1783135318.075010:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135318.075051:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: 000000004a410c23/0xf646e0cda875c6b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135318.075063:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: 000000004a410c23/0xf646e0cda875c6b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135318.075072:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: 000000004a410c23/0xf646e0cda875c6b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135318.075094:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000d30c71b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813228032:0@lo:101: 00000100:00100000:2.0:1783135318.075162:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135318.075269:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 0000000083c51ecb going to sleep for 11 seconds 00000100:00100000:0.0:1783135318.082006:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813228032 00000100:00100000:0.0:1783135318.082021:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813228032 00000100:00100000:2.0:1783135318.085838:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135318.085854:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026f6afb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:5791:x1869752813228032:12345-0@lo:101: 00010000:00010000:2.0:1783135318.085872:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135318.087005:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000010be2e33/0xf646e0cda875c6b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c6b1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135318.087044:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000010be2e33/0xf646e0cda875c6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135318.087055:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000010be2e33/0xf646e0cda875c6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135318.087063:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000010be2e33, rc 0) 00000100:00100000:2.0:1783135318.087143:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026f6afb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813228032:12345-0@lo:101: Request processed in 1294us (11981us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135318.087152:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135318.088452:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000d30c71b7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813228032:0@lo:101: 00010000:00010000:1.0:1783135318.088474:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: 000000004a410c23/0xf646e0cda875c6b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135318.088491:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: 000000004a410c23/0xf646e0cda875c6b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135318.088559:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a53efec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813228160:0@lo:501: 00000100:00100000:1.0:1783135318.088601:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135318.088644:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 0000000076857ac3 going to sleep for 11 seconds 00000100:00100000:0.0:1783135318.090088:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813228160 00000100:00100000:0.0:1783135318.090098:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813228160 00000100:00100000:0.0:1783135318.090144:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135318.090153:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd11bbbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813228160:12345-0@lo:501: 00000100:00100000:0.0:1783135318.090473:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd11bbbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813228160:12345-0@lo:501: Request processed in 320us (1870us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135318.090481:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135318.092654:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a53efec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813228160:0@lo:501: 00000100:00100000:1.0:1783135318.092723:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003a53efec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813228288:0@lo:503: 00000100:00100000:1.0:1783135318.092790:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135318.092870:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set 0000000076857ac3 going to sleep for 11 seconds 00000100:00100000:1.0:1783135318.092934:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813228288 00000100:00100000:1.0:1783135318.092941:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813228288 00000100:00100000:1.0:1783135318.092984:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783135318.092992:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cad1860b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813228288:12345-0@lo:503: 00000100:00100000:1.0:1783135318.093244:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cad1860b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813228288:12345-0@lo:503: Request processed in 252us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135318.093253:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135318.093283:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003a53efec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813228288:0@lo:503: 00000100:00100000:0.0:1783135318.097229:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000589cfcd0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6478:1869752813228416:0@lo:502: 00000100:00100000:0.0:1783135318.097315:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135318.097377:0:6478:0:(client.c:2701:ptlrpc_set_wait()) set 00000000e10cc8dd going to sleep for 11 seconds 00000100:00100000:3.0:1783135318.097439:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813228416 00000100:00100000:3.0:1783135318.097446:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813228416 00000100:00100000:3.0:1783135318.097492:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135318.097500:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040ddc328 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6478:x1869752813228416:12345-0@lo:502: 00000100:00100000:3.0:1783135318.097762:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040ddc328 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6478:x1869752813228416:12345-0@lo:502: Request processed in 262us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135318.097770:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135318.098102:0:6478:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000589cfcd0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6478:1869752813228416:0@lo:502: 00000020:01000000:1.0:1783135318.098132:0:6478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135318.098142:0:6478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135318.098144:0:6478:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783135318.098152:0:6478:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8f063e9800 00000020:00000080:1.0:1783135318.098155:0:6478:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783135318.098201:0:6478:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6478:1869752813228544:0@lo:502: 00000100:00100000:1.0:1783135318.098238:0:6478:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135318.098265:0:6478:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08679240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135318.098334:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813228544 00000100:00100000:0.0:1783135318.098339:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813228544 00000100:00100000:0.0:1783135318.098386:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135318.098393:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6478:x1869752813228544:12345-0@lo:502: 00000100:00100000:0.0:1783135318.098519:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6478:x1869752813228544:12345-0@lo:502: Request processed in 126us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135318.098526:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135318.098675:0:6478:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6478:1869752813228544:0@lo:502: 00000020:01000000:1.0:1783135318.098695:0:6478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135318.098700:0:6478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135318.098702:0:6478:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783135318.098707:0:6478:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1783135318.099018:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783135318.099041:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135318.099050:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135318.099060:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135318.976891:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135319.995451:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135320.191854:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813228672:0@lo:400: 00000100:00100000:1.0:1783135320.191932:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135320.192000:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813228800:0@lo:400: 00000100:00100000:1.0:1783135320.192028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135320.192065:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813228672 00000100:00100000:1.0:1783135320.192072:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813228672 00000100:00100000:1.0:1783135320.192121:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135320.192130:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:3312:x1869752813228672:12345-0@lo:400: 00000100:00100000:1.0:1783135320.192185:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:3312:x1869752813228672:12345-0@lo:400: Request processed in 56us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135320.192193:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783135320.192226:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813228800 00000100:00100000:1.0:1783135320.192230:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813228800 00000100:00100000:1.0:1783135320.192256:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135320.192263:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813228800:12345-0@lo:400: 00000100:00100000:1.0:1783135320.192310:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813228800:12345-0@lo:400: Request processed in 48us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135320.192317:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135320.192362:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813228672:0@lo:400: 00010000:00080000:1.0:1783135320.192395:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8f10b5f800 x1869752813228800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135320.192573:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813228800:0@lo:400: 00000020:01000004:3.0:1783135320.789112:0:6585:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135320.789116:0:6585:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783135320.789255:0:6585:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8f04f38800 00000020:01000004:3.0:1783135320.789272:0:6585:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783135320.789285:0:6585:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783135320.789299:0:6585:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e8f062a0000) 00000020:00000080:3.0:1783135320.789324:0:6585:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783135320.804540:0:6585:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783135320.804986:0:6585:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783135320.825540:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783135320.841762:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783135320.841798:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783135320.842130:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783135320.842174:0:6585:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783135320.843190:0:6585:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1783135320.843201:0:6585:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135320.843212:0:6585:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf646e0cda875c6c6 00000020:01000004:3.0:1783135320.843220:0:6585:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1783135320.843239:0:6585:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783135320.843242:0:6585:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783135320.843249:0:6585:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1783135320.843253:0:6585:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1783135320.843273:0:6585:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e8f05393380) 00000020:00000080:3.0:1783135320.843698:0:6585:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1783135320.848228:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135320.849117:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783135320.849125:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1783135320.857708:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1783135320.857721:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1783135320.860764:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1783135320.860783:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1783135320.870176:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135320.870363:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1783135320.870370:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783135320.878461:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135320.878475:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783135320.906946:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135320.907204:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783135320.907211:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783135320.909717:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783135320.909733:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783135320.914538:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783135320.914564:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1783135320.917472:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135320.917661:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135320.917667:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783135320.918319:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135320.918332:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783135320.979042:0:6585:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135320.979207:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135320.979212:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783135320.980531:0:6585:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135320.980543:0:6585:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783135320.981253:0:6585:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783135320.981352:0:6585:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783135320.981358:0:6585:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00010000:00010000:3.0:1783135321.023250:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1783135321.044376:0:6585:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783135321.044418:0:6585:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.160@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783135321.044423:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783135321.044424:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135321.044426:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135321.044427:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135321.044428:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135321.044430:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135321.044432:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135321.044433:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135321.044435:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135321.044436:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135321.044438:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135321.044443:0:6585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783135321.044446:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135321.044447:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135321.044448:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135321.044450:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135321.044451:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135321.044452:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135321.044453:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135321.044454:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135321.044455:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135321.044456:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135321.044457:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783135321.044481:0:6585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783135321.044502:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813228928:0@lo:253: 00000100:00100000:3.0:1783135321.044578:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.046437:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135321.054543:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813228928 00000100:00100000:1.0:1783135321.054557:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813228928 00000100:00100000:0.0:1783135321.054780:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135321.054791:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813228928:12345-0@lo:253: 20000000:01000000:0.0:1783135321.054882:0:5788:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783135321.054887:0:5788:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1783135321.054892:0:5788:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1783135321.054896:0:5788:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1783135321.059233:0:5788:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135321.062266:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1783135321.062298:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1783135321.062407:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1783135321.062417:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1783135321.062452:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1783135321.062504:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1783135321.063551:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1783135321.063577:0:5788:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.160@tcp 20000000:01000000:0.0:1783135321.063579:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.160@tcp (null) (null) (null) 00000040:00080000:0.0:1783135321.068724:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1783135321.068754:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783135321.068954:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1783135321.068963:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.160@tcp (null) (null) 00000040:00080000:0.0:1783135321.069382:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1783135321.069394:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783135321.069431:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1783135321.069523:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1783135321.073166:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1783135321.073218:0:5788:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.160@tcp 20000000:01000000:0.0:1783135321.073221:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.160@tcp (null) (null) (null) 00000040:00080000:0.0:1783135321.073455:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1783135321.073465:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783135321.073499:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1783135321.073506:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.160@tcp (null) (null) 00000040:00080000:0.0:1783135321.073554:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1783135321.073564:0:5788:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1783135321.073594:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1783135321.074199:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1783135321.074224:0:5788:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1783135321.074227:0:5788:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1783135321.074231:0:5788:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1783135321.074244:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783135321.074247:0:5788:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1783135321.074446:0:5788:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783135321.074449:0:5788:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783135321.075479:0:6600:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1783135321.075539:0:6600:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1783135321.075586:0:6600:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1783135321.076566:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1783135321.076746:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1783135321.076784:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1783135321.076798:0:5788:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783135321.076800:0:5788:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783135321.077573:0:6601:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783135321.078182:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1783135321.078236:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1783135321.078941:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1783135321.078959:0:5788:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783135321.078962:0:5788:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1783135321.079804:0:6602:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1783135321.080096:0:6602:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1783135321.080151:0:6602:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1783135321.081205:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1783135321.081264:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1783135321.084773:0:5788:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1783135321.085487:0:5788:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1783135321.085491:0:5788:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1783135321.085502:0:5788:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1783135321.085528:0:5788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.085548:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c5ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.085556:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c609 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c602 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.085563:0:5788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c679 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c672 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.085571:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.085963:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c679 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c672 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.085979:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c672 expref: 12 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.086010:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1869752813229056:0@lo:104: 00000100:00100000:2.0:1783135321.086074:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135321.086191:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c602 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.086200:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c602 expref: 12 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.086208:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1869752813229184:0@lo:104: 00000100:00100000:2.0:1783135321.086230:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783135321.095911:0:5788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.095931:0:5788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 12 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.095947:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1869752813229312:0@lo:104: 00000100:00100000:2.0:1783135321.096014:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135321.098651:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813229056 00000100:00100000:1.0:1783135321.098667:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813229056 00000100:00100000:0.0:1783135321.098860:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813229184 00000100:00100000:0.0:1783135321.098867:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813229184 00000100:00100000:0.0:1783135321.098896:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135321.098906:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:5788:x1869752813229056:12345-0@lo:104: 00010000:00010000:0.0:1783135321.098925:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.099025:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135321.099031:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:5788:x1869752813229056:12345-0@lo:104: Request processed in 127us (12958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.099039:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135321.099078:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135321.099084:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5788:x1869752813229184:12345-0@lo:104: 00010000:00010000:0.0:1783135321.099093:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f42157000/0xf646e0cda875c602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.099137:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135321.099144:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5788:x1869752813229184:12345-0@lo:104: Request processed in 60us (12913us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.099153:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783135321.099158:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135321.099175:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.099181:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135321.099195:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2a00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135321.099200:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c672 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.099214:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135321.099224:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c672 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135321.099231:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135321.099321:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c672 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.099328:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135321.099361:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c672 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.099369:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c672 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c679 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.099389:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135321.099391:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135321.099393:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135321.099426:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813229440:0@lo:103: 00000100:00100000:3.0:1783135321.099499:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783135321.106992:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135321.107001:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135321.107004:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135321.108270:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813229440 00000100:00100000:3.0:1783135321.108289:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813229440 00010000:00010000:3.0:1783135321.108362:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c679 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c672 expref: 13 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.108412:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135321.108423:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:3314:x1869752813229440:12345-0@lo:103: 00010000:00010000:3.0:1783135321.108444:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135321.108451:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c679 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c672 expref: 13 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.108463:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c679 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c672 expref: 13 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.108488:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135321.111012:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42157000/0xf646e0cda875c602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.111032:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42157000 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:0.0:1783135321.111036:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157000/0xf646e0cda875c602 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.111047:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42157000/0xf646e0cda875c602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135321.111056:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157000/0xf646e0cda875c602 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135321.111062:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135321.111113:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42157000/0xf646e0cda875c602 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.111119:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135321.111138:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157000/0xf646e0cda875c602 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.111164:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42157000/0xf646e0cda875c602 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c609 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.111184:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135321.111186:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135321.111189:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135321.111207:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813229568:0@lo:103: 00000100:00100000:1.0:1783135321.111350:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813229312 00000100:00100000:1.0:1783135321.111358:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813229312 00000100:00100000:1.0:1783135321.111398:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135321.111406:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5788:x1869752813229312:12345-0@lo:104: 00010000:00010000:1.0:1783135321.111416:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875c5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.111659:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05604780 going to sleep for 11 seconds 00010000:00010000:2.0:1783135321.111685:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c679 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c672 expref: 13 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.111700:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1869752813229056:0@lo:104: 00000100:00100000:2.0:1783135321.111712:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1869752813229184:0@lo:104: 00000100:00100000:3.0:1783135321.120081:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:3314:x1869752813229440:12345-0@lo:103: Request processed in 11640us (20563us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135321.120101:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135321.120158:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813229440:0@lo:103: 00000100:00100000:0.0:1783135321.120992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135321.121202:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135321.121212:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5788:x1869752813229312:12345-0@lo:104: Request processed in 9805us (25203us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135321.121224:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1783135321.121256:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135321.121264:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875c5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.121289:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3800 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135321.121317:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875c5e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135321.121423:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5788:1869752813229312:0@lo:104: 00010000:00010000:0.0:1783135321.121450:0:5788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.121542:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875c5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135321.121551:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875c5e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135321.121558:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135321.121608:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875c5e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.121614:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135321.121632:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875c5e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.121639:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875c5e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c5ed expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.121656:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135321.121658:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135321.121660:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135321.121714:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135321.121727:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813229696:0@lo:103: 00000100:00100000:0.0:1783135321.121766:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135321.122064:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813229568 00000100:00100000:2.0:1783135321.122078:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813229568 00010000:00010000:2.0:1783135321.122103:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c602 expref: 12 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.122159:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813229696 00000100:00100000:2.0:1783135321.122162:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813229696 00010000:00010000:2.0:1783135321.122172:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 13 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135321.122199:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135321.122208:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:3311:x1869752813229568:12345-0@lo:103: 00010000:00010000:0.0:1783135321.122223:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135321.122230:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c609 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c602 expref: 13 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.122235:0:5780:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1783135321.122243:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c609 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c602 expref: 13 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.122256:0:5780:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1783135321.122262:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c609 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c602 expref: 13 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.122304:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135321.126656:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:3311:x1869752813229568:12345-0@lo:103: Request processed in 4436us (5654us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.126671:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135321.126717:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135321.126730:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:3311:x1869752813229696:12345-0@lo:103: 00010000:00010000:0.0:1783135321.126752:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135321.126762:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c5ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 11 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126779:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c5ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 11 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126801:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c5ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c5e6 expref: 11 pid: 5788 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126842:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126851:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126867:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126874:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126881:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126906:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126912:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135321.126917:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126925:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126943:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.126954:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135321.126985:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:3311:x1869752813229696:12345-0@lo:103: Request processed in 261us (5218us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.126992:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1783135321.127023:0:5788:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.127031:0:5788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.127037:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c6d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783135321.127051:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783135321.128484:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813229696:0@lo:103: 00000100:00100000:1.0:1783135321.128498:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813229568:0@lo:103: 00000100:00100000:0.0:1783135321.202232:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:6585:x1869752813228928:12345-0@lo:253: Request processed in 147433us (157645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.202247:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135321.202418:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813228928:0@lo:253: 10000000:01000000:3.0:1783135321.202433:0:6585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783135321.202436:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135321.202438:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783135321.202439:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135321.202445:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1783135321.202446:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135321.202448:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135321.202449:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135321.202451:0:6585:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783135321.202452:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135321.202453:0:6585:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783135321.202470:0:6585:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8f04f38800 from lustre-OST0000 10000000:01000000:3.0:1783135321.202494:0:6585:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783135321.202496:0:6585:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783135321.202504:0:6585:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8f062a19c0 local copy 10000000:01000000:3.0:1783135321.202508:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783135321.202543:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.202554:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.202563:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.202582:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813229824:0@lo:101: 00000100:00100000:3.0:1783135321.202745:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.202882:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9a180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135321.203058:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813229824 00000100:00100000:1.0:1783135321.203065:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813229824 00000100:00100000:1.0:1783135321.203221:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135321.203232:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:6585:x1869752813229824:12345-0@lo:101: 00010000:00010000:1.0:1783135321.203246:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135321.203268:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42157800/0xf646e0cda875c6e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c6db expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.203294:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42157800/0xf646e0cda875c6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c6db expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.206472:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42157800/0xf646e0cda875c6e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c6db expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.206501:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42157800, rc 0) 00000100:00100000:1.0:1783135321.206614:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:6585:x1869752813229824:12345-0@lo:101: Request processed in 3369us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135321.206623:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135321.206873:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813229824:0@lo:101: 00010000:00010000:3.0:1783135321.206894:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.206904:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.207165:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813229952:0@lo:501: 00000100:00100000:3.0:1783135321.207218:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.209808:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9a180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135321.211245:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813229952 00000100:00100000:0.0:1783135321.211261:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813229952 00000100:00100000:0.0:1783135321.211361:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135321.211374:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:6585:x1869752813229952:12345-0@lo:501: 00000100:00100000:0.0:1783135321.211724:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:6585:x1869752813229952:12345-0@lo:501: Request processed in 350us (4504us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135321.211733:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135321.212060:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813229952:0@lo:501: 10000000:01000000:3.0:1783135321.212083:0:6585:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783135321.212119:0:6585:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783135321.212128:0:6585:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.212138:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.212158:0:6585:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.212186:0:6585:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783135321.212210:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8f04f38800 10000000:01000000:3.0:1783135321.212215:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783135321.212221:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e8f062a19c0 10000000:01000000:3.0:1783135321.212225:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783135321.212228:0:6585:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8e8f062a19c0 from 1 10000000:01000000:3.0:1783135321.212232:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783135321.212264:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.212273:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.212283:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.212334:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230080:0@lo:101: 00000100:00100000:3.0:1783135321.212377:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.212404:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9ac00 going to sleep for 11 seconds 00010000:00010000:0.0:1783135321.212734:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135321.212741:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.212749:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f029c9600 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:0.0:1783135321.212753:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.213082:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135321.213092:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135321.213098:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135321.213121:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.213127:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135321.213164:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.213172:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9600/0xf646e0cda875c6db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xf646e0cda875c6e2 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.213202:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135321.213204:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135321.213206:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135321.213219:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813230080 00000100:00100000:0.0:1783135321.213225:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813230080 00000100:00100000:0.0:1783135321.213259:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1783135321.213268:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:6585:x1869752813230080:12345-0@lo:101: 00010000:00010000:0.0:1783135321.213280:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135321.213299:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c6f0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c6e9 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.213454:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c6f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c6e9 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.213466:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c6f0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c6e9 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.213475:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f00030800, rc 0) 00000100:00100000:0.0:1783135321.213524:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230080:12345-0@lo:101: Request processed in 256us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.213531:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135321.215172:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813230208:0@lo:103: 00000100:00100000:3.0:1783135321.215253:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.215588:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230080:0@lo:101: 00010000:00010000:3.0:1783135321.215751:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6f0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.215767:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c6f0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135321.215793:0:6585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1783135321.215805:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6f0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.215849:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6f0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135321.215859:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783135321.215865:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135321.215873:0:6585:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1783135321.215875:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1783135321.215915:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.215924:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.215983:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.216078:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230336:0@lo:101: 00000100:00100000:3.0:1783135321.216115:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.216133:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135321.216485:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813230208 00000100:00100000:0.0:1783135321.216496:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813230208 00000100:00100000:0.0:1783135321.216553:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135321.216563:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:3313:x1869752813230208:12345-0@lo:103: 00010000:00010000:0.0:1783135321.216577:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135321.216591:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42157800/0xf646e0cda875c6e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c6db expref: 11 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.216754:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135321.216805:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:3313:x1869752813230208:12345-0@lo:103: Request processed in 243us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.216835:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135321.216885:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813230208:0@lo:103: 00000100:00100000:0.0:1783135321.216910:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813230336 00000100:00100000:0.0:1783135321.216913:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813230336 00000100:00100000:0.0:1783135321.216931:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783135321.216938:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+10:6585:x1869752813230336:12345-0@lo:101: 00010000:00010000:0.0:1783135321.216952:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135321.216967:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c6f7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.216985:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.217007:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 11 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135321.217015:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f00030a00, rc 0) 00000100:00100000:0.0:1783135321.217042:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230336:12345-0@lo:101: Request processed in 105us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.217048:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135321.217855:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230336:0@lo:101: 00010000:00010000:3.0:1783135321.217876:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.217888:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.218099:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230464:0@lo:501: 00000100:00100000:3.0:1783135321.218428:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.218469:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135321.220161:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813230464 00000100:00100000:0.0:1783135321.220176:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813230464 00000100:00100000:0.0:1783135321.220233:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783135321.220243:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230464:12345-0@lo:501: 00000100:00100000:0.0:1783135321.221100:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230464:12345-0@lo:501: Request processed in 854us (2668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.221110:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135321.221395:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230464:0@lo:501: 00000100:00100000:3.0:1783135321.221447:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230592:0@lo:503: 00000100:00100000:3.0:1783135321.221489:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.221518:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135321.221753:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813230592 00000100:00100000:0.0:1783135321.221761:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813230592 00000100:00100000:0.0:1783135321.221794:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783135321.221802:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230592:12345-0@lo:503: 00000100:00100000:0.0:1783135321.222006:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230592:12345-0@lo:503: Request processed in 205us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.222014:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135321.224632:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230592:0@lo:503: 00000040:00080000:3.0:1783135321.225534:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783135321.225650:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230720:0@lo:502: 00000100:00100000:3.0:1783135321.225722:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.225764:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135321.225954:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813230720 00000100:00100000:0.0:1783135321.225961:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813230720 00000100:00100000:0.0:1783135321.226010:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135321.226019:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230720:12345-0@lo:502: 00000100:00100000:0.0:1783135321.226237:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230720:12345-0@lo:502: Request processed in 218us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.226244:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135321.226744:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230720:0@lo:502: 00000040:00080000:3.0:1783135321.227123:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1783135321.227253:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1783135321.227373:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1783135321.227429:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1783135321.227467:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1783135321.227500:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1783135321.227533:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230848:0@lo:502: 00000100:00100000:3.0:1783135321.227590:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.228418:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9ac00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135321.229845:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813230848 00000100:00100000:0.0:1783135321.229858:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813230848 00000100:00100000:0.0:1783135321.229911:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783135321.229920:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230848:12345-0@lo:502: 00000100:00100000:0.0:1783135321.231191:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230848:12345-0@lo:502: Request processed in 1268us (3596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.231203:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783135321.234123:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230848:0@lo:502: 00000040:00080000:3.0:1783135321.237571:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1783135321.237597:0:6585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1783135321.238783:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135321.238793:0:6605:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1783135321.238799:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135321.238808:0:6605:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783135321.238886:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135321.238911:0:6605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e8f37c48000) 00000020:00000080:0.0:1783135321.238932:0:6605:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783135321.238939:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783135321.239064:0:6605:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8f04f38800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783135321.239072:0:6605:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783135321.239079:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf646e0cda875c70c 00010000:00010000:1.0:1783135321.252455:0:6605:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1783135321.253555:0:6605:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1783135321.260347:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783135321.265051:0:6605:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1783135321.288075:0:6605:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1783135321.292079:0:6605:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1783135321.293967:0:6605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1783135321.293978:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135321.293985:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135321.293987:0:6605:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1783135321.293990:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135321.293993:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135321.293995:0:6605:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783135321.293998:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783135321.294000:0:6605:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783135321.294050:0:6605:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135321.294054:0:6605:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135321.294055:0:6605:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783135321.294058:0:6605:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783135321.294220:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1783135321.294245:0:6585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783135321.294271:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.294301:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135321.294318:0:6585:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f04f38800 from 1 10000000:01000000:3.0:1783135321.294321:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135321.294357:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.294366:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.294392:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.294417:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230976:0@lo:101: 00000100:00100000:3.0:1783135321.294489:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.294591:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9af00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135321.300759:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813230976 00000100:00100000:3.0:1783135321.300778:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813230976 00000100:00100000:3.0:1783135321.300870:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135321.300884:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:6585:x1869752813230976:12345-0@lo:101: 00010000:00010000:3.0:1783135321.300908:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135321.300928:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c713 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.300962:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c713 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.300975:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c713 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.300984:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f029c8e00, rc 0) 00000100:00100000:3.0:1783135321.301260:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813230976:12345-0@lo:101: Request processed in 378us (6770us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135321.301666:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813230976:0@lo:101: 00010000:00010000:2.0:1783135321.301686:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.301696:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.301866:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231104:0@lo:501: 00000100:00100000:2.0:1783135321.301910:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135321.301946:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f056043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135321.301965:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813231104 00000100:00100000:2.0:1783135321.301970:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813231104 00000100:00100000:2.0:1783135321.302015:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135321.302023:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813231104:12345-0@lo:501: 00000100:00100000:2.0:1783135321.302244:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813231104:12345-0@lo:501: Request processed in 222us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135321.302251:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135321.302301:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231104:0@lo:501: 00000100:00100000:2.0:1783135321.302354:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231232:0@lo:503: 00000100:00100000:3.0:1783135321.302806:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783135321.303081:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135321.303117:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f056043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135321.303136:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813231232 00000100:00100000:2.0:1783135321.303142:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813231232 00000100:00100000:2.0:1783135321.303175:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135321.303183:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813231232:12345-0@lo:503: 00000100:00100000:2.0:1783135321.303401:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813231232:12345-0@lo:503: Request processed in 219us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135321.303408:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135321.303454:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231232:0@lo:503: 00000040:00080000:2.0:1783135321.303740:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135321.303806:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231360:0@lo:502: 00000100:00100000:2.0:1783135321.303875:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135321.303898:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f056043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135321.304590:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813231360 00000100:00100000:3.0:1783135321.304609:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813231360 00000100:00100000:3.0:1783135321.304651:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1783135321.304660:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813231360:12345-0@lo:502: 00000100:00100000:3.0:1783135321.304856:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813231360:12345-0@lo:502: Request processed in 196us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135321.304863:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783135321.305200:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231360:0@lo:502: 00000040:00080000:2.0:1783135321.305560:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783135321.305688:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783135321.305721:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231488:0@lo:502: 00000100:00100000:2.0:1783135321.305762:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135321.305934:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f056043c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135321.305981:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813231488 00000100:00100000:3.0:1783135321.305986:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813231488 00000100:00100000:3.0:1783135321.306127:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783135321.306136:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813231488:12345-0@lo:502: 00000100:00100000:3.0:1783135321.306407:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813231488:12345-0@lo:502: Request processed in 271us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135321.306414:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135321.306489:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231488:0@lo:502: 00000040:00080000:1.0:1783135321.306591:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783135321.306682:0:6585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783135321.307783:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135321.307799:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135321.307802:0:6609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783135321.307810:0:6609:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8f04f38800 00000020:00000080:2.0:1783135321.307885:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135321.307921:0:6609:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135321.307925:0:6609:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135321.307926:0:6609:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783135321.307929:0:6609:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783135321.308076:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783135321.308096:0:6585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135321.308154:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.308166:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135321.308401:0:6585:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783135321.308405:0:6585:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8f04f38800 10000000:01000000:1.0:1783135321.308408:0:6585:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8f04f38800 10000000:01000000:1.0:1783135321.308412:0:6585:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135321.308419:0:6585:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f04f38800 from 1 10000000:01000000:1.0:1783135321.308421:0:6585:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135321.308461:0:6585:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.308470:0:6585:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.308481:0:6585:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135321.308504:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231616:0@lo:101: 00000100:00100000:1.0:1783135321.308568:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135321.308703:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813231616 00000100:00100000:3.0:1783135321.308710:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813231616 00000100:00100000:3.0:1783135321.308751:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783135321.308762:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813231616:12345-0@lo:101: 00010000:00010000:3.0:1783135321.308776:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135321.308788:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c721 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.308834:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c721 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.308845:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c721 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135321.308855:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f029c8a00, rc 0) 00000100:00100000:3.0:1783135321.308888:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813231616:12345-0@lo:101: Request processed in 128us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135321.308895:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135321.308907:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0569ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135321.308928:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231616:0@lo:101: 00010000:00010000:1.0:1783135321.308942:0:6585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.308962:0:6585:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135321.309050:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231744:0@lo:501: 00000100:00100000:1.0:1783135321.309076:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135321.309093:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0569ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135321.309693:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813231744 00000100:00100000:3.0:1783135321.309699:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813231744 00000100:00100000:3.0:1783135321.309746:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783135321.309755:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813231744:12345-0@lo:501: 00000100:00100000:3.0:1783135321.310065:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813231744:12345-0@lo:501: Request processed in 311us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135321.310072:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1783135321.310173:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231744:0@lo:501: 00000100:00100000:1.0:1783135321.310434:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231872:0@lo:503: 00000100:00100000:1.0:1783135321.310477:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135321.310506:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0569ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135321.310510:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813231872 00000100:00100000:0.0:1783135321.310515:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813231872 00000100:00100000:0.0:1783135321.310552:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783135321.310560:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813231872:12345-0@lo:503: 00000100:00100000:0.0:1783135321.310951:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813231872:12345-0@lo:503: Request processed in 392us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135321.310954:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813231872:0@lo:503: 00000100:00100000:0.0:1783135321.310958:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000040:00080000:1.0:1783135321.311678:0:6585:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135321.311745:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813232000:0@lo:502: 00000100:00100000:1.0:1783135321.311782:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135321.311836:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0569ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135321.311844:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813232000 00000100:00100000:3.0:1783135321.311849:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813232000 00000100:00100000:3.0:1783135321.311886:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135321.311894:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813232000:12345-0@lo:502: 00000100:00100000:0.0:1783135321.312482:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813232000:12345-0@lo:502: Request processed in 588us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135321.312489:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783135321.312703:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813232000:0@lo:502: 00000040:00080000:1.0:1783135321.312931:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783135321.312973:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783135321.312993:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783135321.313040:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783135321.313073:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783135321.313101:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783135321.313137:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783135321.313171:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783135321.313208:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783135321.313228:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783135321.313258:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783135321.313359:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783135321.313387:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783135321.313404:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783135321.313429:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783135321.313447:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783135321.313464:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783135321.313488:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783135321.313506:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1783135321.313523:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1783135321.313548:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1783135321.313566:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1783135321.313599:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1783135321.315553:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1783135321.315584:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1783135321.315667:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1783135321.315706:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1783135321.315727:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1783135321.315764:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813232128:0@lo:502: 00000100:00100000:1.0:1783135321.315870:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135321.315944:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0569ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135321.316021:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813232128 00000100:00100000:3.0:1783135321.316028:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813232128 00000100:00100000:3.0:1783135321.316074:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135321.316084:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813232128:12345-0@lo:502: 00000100:00100000:3.0:1783135321.316434:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813232128:12345-0@lo:502: Request processed in 351us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135321.316442:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135321.316723:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813232128:0@lo:502: 00000040:00080000:0.0:1783135321.316802:0:6585:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783135321.316945:0:6585:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1783135321.317676:0:6610:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783135321.317693:0:6610:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e8f3fc319c0) 00000020:00000080:2.0:1783135321.317729:0:6610:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1783135321.318122:0:6610:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8f04f38800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783135321.318127:0:6610:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8f04f38800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783135321.318130:0:6610:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8f04f38800 3 00010000:00080000:2.0:1783135321.318161:0:6610:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8e01828000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.160@tcp at head 00010000:00010000:3.0:1783135321.323705:0:6610:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1783135321.323845:0:6610:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783135321.323887:0:6610:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135321.323900:0:6610:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf646e0cda875c736 00000100:00080000:3.0:1783135321.323913:0:6610:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135321.323920:0:6610:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e8e01828000 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:3.0:1783135321.323959:0:6610:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f05732300 x1869752813232256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135321.323979:0:6610:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783135321.324084:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1869752813232256:0@lo:38: 00000100:00100000:1.0:1783135321.324158:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135321.324219:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813232256 00000100:00100000:1.0:1783135321.324226:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813232256 00000100:00100000:1.0:1783135321.324257:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135321.324265:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1869752813232256:12345-0@lo:38: 00010000:00080000:1.0:1783135321.324289:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:1.0:1783135321.324328:0:5796:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf646e0cda875c73d 00000004:00100000:1.0:1783135321.324344:0:5796:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1783135321.324379:0:5796:0:(import.c:65:import_set_state_nolock()) ffff8e8e01818000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135321.324393:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813232384:0@lo:400: 00000100:00100000:2.0:1783135321.324426:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135321.324437:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869752813232256:12345-0@lo:38: Request processed in 170us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135321.324444:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135321.324463:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813232384 00000100:00100000:1.0:1783135321.324466:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813232384 00000100:00100000:1.0:1783135321.324488:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135321.324494:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813232384:12345-0@lo:400: 00000100:00100000:1.0:1783135321.324535:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813232384:12345-0@lo:400: Request processed in 41us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135321.324541:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783135321.324576:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8f05732300 x1869752813232256/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135321.324586:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135321.324593:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1783135321.324608:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783135321.324612:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783135321.324614:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8e01828000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135321.324622:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1869752813232256:0@lo:38: 00000040:00080000:3.0:1783135321.324902:0:6610:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1783135321.325084:0:6585:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00010000:00080000:2.0:1783135321.325109:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8f3b9ddf80 x1869752813232384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783135321.325110:0:6585:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00000100:00100000:2.0:1783135321.325120:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813232384:0@lo:400: 00010000:00010000:1.0:1783135321.325131:0:6585:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.325141:0:6585:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783135321.325191:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783135321.325197:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135321.325198:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135321.325199:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135321.325200:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135321.325202:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135321.325203:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135321.325204:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783135321.325205:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783135321.325207:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135321.325208:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135321.325212:0:6585:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1783135321.325214:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135321.325215:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135321.325216:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135321.325217:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135321.325218:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135321.325219:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135321.325220:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135321.325221:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783135321.325221:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783135321.325222:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135321.325223:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783135321.325247:0:6585:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783135321.325258:0:6585:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813232512:0@lo:253: 00000100:00100000:1.0:1783135321.325295:0:6585:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135321.325339:0:6585:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0569ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135321.325450:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813232512 00000100:00100000:2.0:1783135321.325456:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813232512 00000100:00100000:2.0:1783135321.328099:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135321.328115:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6585:x1869752813232512:12345-0@lo:253: 20000000:01000000:2.0:1783135321.328164:0:5787:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783135321.328188:0:5787:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1783135321.361506:0:5787:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783135321.361531:0:5787:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783135321.361617:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783135321.361622:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783135321.361648:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.361668:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c6a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c69c expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.361677:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.361735:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c6a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c69c expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135321.361751:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c6a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c69c expref: 13 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135321.361766:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869752813232640:0@lo:104: 00000100:00100000:1.0:1783135321.361867:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135321.361917:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0569a180 going to sleep for 11 seconds 00000100:00100000:2.0:1783135321.362118:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813232640 00000100:00100000:2.0:1783135321.362126:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813232640 00000100:00100000:2.0:1783135321.362197:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135321.362207:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5810:x1869752813232640:12345-0@lo:104: 00010000:00010000:2.0:1783135321.362222:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f00030600/0xf646e0cda875c69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362488:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135321.362496:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5810:x1869752813232640:12345-0@lo:104: Request processed in 291us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135321.362504:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1783135321.362530:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135321.362537:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f00030600/0xf646e0cda875c69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362546:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f00030600 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135321.362550:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00030600/0xf646e0cda875c69c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362561:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f00030600/0xf646e0cda875c69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135321.362570:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00030600/0xf646e0cda875c69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135321.362577:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783135321.362622:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f00030600/0xf646e0cda875c69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362629:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135321.362647:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f00030600/0xf646e0cda875c69c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362654:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f00030600/0xf646e0cda875c69c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6a3 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362681:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135321.362683:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135321.362685:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135321.362700:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813232768:0@lo:103: 00000100:00100000:2.0:1783135321.362735:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135321.362775:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813232768 00000100:00100000:2.0:1783135321.362780:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813232768 00010000:00010000:2.0:1783135321.362798:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c6a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c69c expref: 14 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.362854:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135321.362861:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c88050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:3311:x1869752813232768:12345-0@lo:103: 00010000:00010000:2.0:1783135321.362872:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135321.362876:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c6a3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c69c expref: 14 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362886:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c6a3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c69c expref: 14 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362902:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362909:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135321.362921:0:5781:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001887877s 00010000:00010000:2.0:1783135321.362925:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362942:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362948:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362953:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362959:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42156400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135321.362963:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362970:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362979:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.362988:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135321.363256:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c88050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:3311:x1869752813232768:12345-0@lo:103: Request processed in 395us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135321.363263:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135321.363417:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813232768:0@lo:103: 00010000:00010000:2.0:1783135321.363443:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c6a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c69c expref: 13 pid: 5789 timeout: 370 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135321.363455:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5c700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869752813232640:0@lo:104: 00010000:00010000:2.0:1783135321.363466:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.363480:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.363486:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135321.363492:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c744 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135321.382626:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:6585:x1869752813232512:12345-0@lo:253: Request processed in 54495us (57309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135321.382642:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783135321.383750:0:6585:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6585:1869752813232512:0@lo:253: 10000000:01000000:1.0:1783135321.383770:0:6585:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783135321.383773:0:6585:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135321.383775:0:6585:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135321.383776:0:6585:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135321.383777:0:6585:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135321.383778:0:6585:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135321.383780:0:6585:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135321.383781:0:6585:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135321.383783:0:6585:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783135321.383785:0:6585:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783135321.383786:0:6585:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135321.383788:0:6585:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783135321.383803:0:6585:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1783135321.394518:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1783135321.394699:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1783135321.394984:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1783135321.395137:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1783135321.395326:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1783135321.395582:0:6585:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783135321.400499:0:6585:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1783135321.648807:0:6585:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1783135321.648831:0:6585:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1783135321.648871:0:6585:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135321.648961:0:6585:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135321.648977:0:6585:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1783135321.649013:0:6585:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1783135322.046364:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135323.067659:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135323.328342:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1783135323.328349:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f063e9800 from 21 10000000:01000000:3.0:1783135323.328356:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783135323.328408:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135323.328422:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135323.328434:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135323.328460:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813232896:0@lo:101: 00000100:00100000:3.0:1783135323.328534:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135323.328588:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04fe6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135323.330174:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813232896 00000100:00100000:2.0:1783135323.330187:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813232896 00000100:00100000:2.0:1783135323.330243:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783135323.330251:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813232896:12345-0@lo:101: 00010000:00010000:2.0:1783135323.330265:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135323.330292:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c74b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135323.330318:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c74b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135323.330329:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c74b expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135323.330338:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3800, rc 0) 00000100:00100000:2.0:1783135323.330418:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813232896:12345-0@lo:101: Request processed in 167us (1885us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135323.330425:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783135323.333544:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813232896:0@lo:101: 00010000:00010000:3.0:1783135323.333575:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135323.333588:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135323.333675:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233024:0@lo:501: 00000100:00100000:3.0:1783135323.333731:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135323.333801:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04fe6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135323.333913:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813233024 00000100:00100000:2.0:1783135323.333920:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813233024 00000100:00100000:2.0:1783135323.333970:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783135323.333979:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813233024:12345-0@lo:501: 00000100:00100000:2.0:1783135323.334424:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813233024:12345-0@lo:501: Request processed in 445us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135323.334431:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783135323.334914:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233024:0@lo:501: 00000100:00100000:3.0:1783135323.335294:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233152:0@lo:503: 00000100:00100000:3.0:1783135323.335348:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135323.335383:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04fe6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135323.337502:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813233152 00000100:00100000:2.0:1783135323.337517:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813233152 00000100:00100000:2.0:1783135323.337591:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783135323.337603:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813233152:12345-0@lo:503: 00000100:00100000:2.0:1783135323.337930:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813233152:12345-0@lo:503: Request processed in 328us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135323.337938:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783135323.339330:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233152:0@lo:503: 00000100:00100000:3.0:1783135323.342698:0:6693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6693:1869752813233280:0@lo:502: 00000100:00100000:3.0:1783135323.342783:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135323.342855:0:6693:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04fe6600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135323.348526:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813233280 00000100:00100000:0.0:1783135323.348540:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813233280 00000100:00100000:0.0:1783135323.348599:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783135323.348608:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6693:x1869752813233280:12345-0@lo:502: 00000100:00100000:0.0:1783135323.348929:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6693:x1869752813233280:12345-0@lo:502: Request processed in 321us (6145us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135323.348960:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783135323.350122:0:6693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6693:1869752813233280:0@lo:502: 00000100:00100000:3.0:1783135323.350199:0:6693:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6693:1869752813233408:0@lo:502: 00000100:00100000:3.0:1783135323.350259:0:6693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135323.350309:0:6693:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04fe6600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135323.350333:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813233408 00000100:00100000:3.0:1783135323.350339:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813233408 00000100:00100000:3.0:1783135323.350376:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783135323.350383:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6693:x1869752813233408:12345-0@lo:502: 00000100:00100000:3.0:1783135323.350585:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:6693:x1869752813233408:12345-0@lo:502: Request processed in 201us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135323.350593:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783135323.350633:0:6693:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6693:1869752813233408:0@lo:502: 00000040:00080000:3.0:1783135323.350651:0:6693:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1783135323.351205:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1783135323.351228:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135323.351239:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.351249:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135323.351277:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135323.351280:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e8f063e9800 from 4 10000000:01000000:0.0:1783135323.351283:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135323.351310:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.351318:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.351327:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135323.351343:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233536:0@lo:101: 00000100:00100000:0.0:1783135323.351378:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135323.351406:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135323.351421:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813233536 00000100:00100000:0.0:1783135323.351425:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813233536 00000100:00100000:0.0:1783135323.351464:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783135323.351472:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813233536:12345-0@lo:101: 00010000:00010000:0.0:1783135323.351482:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135323.351501:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c759 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.351520:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c759 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.351529:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c759 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.351537:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f00030600, rc 0) 00000100:00100000:0.0:1783135323.351565:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813233536:12345-0@lo:101: Request processed in 95us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135323.351571:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783135323.351603:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233536:0@lo:101: 00010000:00010000:0.0:1783135323.351616:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.351625:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135323.351668:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233664:0@lo:256: 00000100:00100000:0.0:1783135323.351694:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135323.351705:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf736c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135323.351715:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813233664 00000100:00100000:0.0:1783135323.351718:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813233664 00000100:00100000:0.0:1783135323.351734:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783135323.351739:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813233664:12345-0@lo:256: 20000000:01000000:0.0:1783135323.351751:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1783135323.351766:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1783135323.351772:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1783135323.352174:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813233664:12345-0@lo:256: Request processed in 132us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135323.352181:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783135323.352211:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233664:0@lo:256: 10000000:01000000:0.0:1783135323.352248:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135323.352254:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.352262:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135323.352279:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783135323.352281:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1783135323.352283:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783135323.352299:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.352306:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.352313:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135323.352324:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233792:0@lo:101: 00000100:00100000:0.0:1783135323.352348:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135323.352376:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf736c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135323.354746:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813233792 00000100:00100000:2.0:1783135323.354759:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813233792 00000100:00100000:2.0:1783135323.354837:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135323.354849:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813233792:12345-0@lo:101: 00010000:00010000:2.0:1783135323.354866:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135323.354894:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c767 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135323.354921:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c767 expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135323.354953:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c767 expref: 15 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135323.354962:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3600, rc 0) 00000100:00100000:2.0:1783135323.355042:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813233792:12345-0@lo:101: Request processed in 196us (2693us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135323.355050:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135323.355103:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233792:0@lo:101: 00010000:00010000:2.0:1783135323.355121:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135323.355131:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135323.355194:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233920:0@lo:501: 00000100:00100000:2.0:1783135323.355226:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135323.355255:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02dda6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135323.355278:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813233920 00000100:00100000:2.0:1783135323.355282:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813233920 00000100:00100000:2.0:1783135323.355299:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783135323.355305:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813233920:12345-0@lo:501: 00000100:00100000:2.0:1783135323.355549:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813233920:12345-0@lo:501: Request processed in 243us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135323.355556:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783135323.355585:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813233920:0@lo:501: 00000100:00100000:2.0:1783135323.355611:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813234048:0@lo:503: 00000100:00100000:2.0:1783135323.355650:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135323.355662:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02dda6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135323.355673:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813234048 00000100:00100000:2.0:1783135323.355676:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813234048 00000100:00100000:2.0:1783135323.355693:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783135323.355698:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813234048:12345-0@lo:503: 00000100:00100000:2.0:1783135323.355935:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813234048:12345-0@lo:503: Request processed in 235us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135323.355941:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783135323.355975:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813234048:0@lo:503: 00000100:00100000:1.0:1783135323.360642:0:6696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6696:1869752813234176:0@lo:502: 00000100:00100000:1.0:1783135323.360719:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135323.360796:0:6696:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0579ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135323.363464:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813234176 00000100:00100000:2.0:1783135323.363479:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813234176 00000100:00100000:1.0:1783135323.363702:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783135323.363713:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:6696:x1869752813234176:12345-0@lo:502: 00000100:00100000:1.0:1783135323.364171:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:6696:x1869752813234176:12345-0@lo:502: Request processed in 459us (3451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135323.364179:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783135323.364581:0:6696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6696:1869752813234176:0@lo:502: 00000020:01000000:1.0:1783135323.364613:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135323.364621:0:6696:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783135323.364628:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135323.364630:0:6696:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783135323.364641:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135323.364645:0:6696:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.160@tcp to nid 0x20000c0a8c9a0 (192.168.201.160@tcp) 00000020:01000000:1.0:1783135323.364667:0:6696:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783135323.364670:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135323.364683:0:6696:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e8f10b63380) 00000020:00000080:1.0:1783135323.364703:0:6696:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1783135323.364707:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135323.364782:0:6696:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783135323.364787:0:6696:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783135323.364793:0:6696:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875c77c 00010000:00080000:1.0:1783135323.365744:0:6696:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8f3d108800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.160@tcp at head 00010000:00010000:1.0:1783135323.366180:0:6696:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1783135323.430308:0:6696:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1783135323.430328:0:6696:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783135323.430978:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135323.431166:0:6696:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135323.431212:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1783135323.431281:0:6696:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1783135323.432215:0:6699:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135323.432221:0:6699:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783135323.434613:0:6696:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135323.434630:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783135323.434673:0:6696:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783135323.434700:0:6696:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875c783 00000100:00080000:1.0:1783135323.434712:0:6696:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135323.434717:0:6696:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8f3d108800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135323.434753:0:6696:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f10b5fb80 x1869752813234304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135323.434783:0:6696:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783135323.434861:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135323.434865:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135323.434867:0:6696:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783135323.434870:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135323.434875:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135323.434876:0:6696:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783135323.434879:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783135323.434881:0:6696:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783135323.434909:0:6696:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6696:1869752813234432:0@lo:502: 00000100:00100000:1.0:1783135323.434989:0:6696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135323.435128:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813234304:0@lo:8: 00000100:00100000:2.0:1783135323.435165:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135323.435200:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813234304 00000100:00100000:2.0:1783135323.435205:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813234304 00000100:00100000:2.0:1783135323.435233:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135323.435238:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1869752813234304:12345-0@lo:8: 00010000:00080000:2.0:1783135323.435256:0:6587:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:2.0:1783135323.435289:0:6587:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875c78a 00002000:00100000:2.0:1783135323.435320:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e8e0182e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783135323.435325:0:6587:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1783135323.435329:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1783135323.435342:0:6696:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0579ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135323.435359:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813234432 00000100:00100000:1.0:1783135323.435363:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813234432 00000100:00100000:1.0:1783135323.435393:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783135323.435399:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:6696:x1869752813234432:12345-0@lo:502: 00002000:00100000:2.0:1783135323.435667:0:6587:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783135323.435799:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783135323.435920:0:6587:0:(import.c:65:import_set_state_nolock()) ffff8e8e0182e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135323.435974:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813234560:0@lo:400: 00000100:00100000:1.0:1783135323.436208:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:6696:x1869752813234432:12345-0@lo:502: Request processed in 808us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135323.436217:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135323.436233:0:6696:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:6696:1869752813234432:0@lo:502: 00000020:01000000:0.0:1783135323.436276:0:6696:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135323.436282:0:6696:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135323.436284:0:6696:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783135323.436289:0:6696:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1783135323.436515:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1783135323.436534:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1783135323.436544:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135323.436566:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135323.436576:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1783135323.436579:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8f062a19c0 from 1 10000000:01000000:1.0:1783135323.436581:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1783135323.436604:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135323.436611:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135323.436618:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135323.436632:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813234816:0@lo:101: 00000100:00100000:1.0:1783135323.436664:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135323.436692:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0ce3a000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135323.436737:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813234816 00000100:00100000:0.0:1783135323.436743:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813234816 00000100:00100000:0.0:1783135323.436781:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135323.436788:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813234816:12345-0@lo:101: 00010000:00010000:0.0:1783135323.436797:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135323.436850:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c791 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.436873:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c791 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.436884:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c791 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135323.436892:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05220800, rc 0) 00000100:00100000:0.0:1783135323.436925:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813234816:12345-0@lo:101: Request processed in 138us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135323.436931:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135323.437027:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813234816:0@lo:101: 00010000:00010000:1.0:1783135323.437040:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135323.437048:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135323.437089:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813234944:0@lo:501: 00000100:00100000:1.0:1783135323.437117:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135323.437139:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0ce3a000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135323.437152:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813234944 00000100:00100000:1.0:1783135323.437155:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813234944 00000100:00100000:1.0:1783135323.437177:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783135323.437183:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813234944:12345-0@lo:501: 00000100:00100000:1.0:1783135323.437401:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813234944:12345-0@lo:501: Request processed in 217us (281us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135323.437408:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783135323.437440:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813234944:0@lo:501: 10000000:01000000:1.0:1783135323.437460:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1783135323.437466:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135323.437473:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135323.438974:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813234688:0@lo:400: 00000100:00100000:0.0:1783135323.439053:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135323.439584:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813234688 00000100:00100000:1.0:1783135323.439592:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813234688 00000100:00100000:1.0:1783135323.439658:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135323.439668:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813234688:12345-0@lo:400: 00000100:00100000:1.0:1783135323.439729:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813234688:12345-0@lo:400: Request processed in 63us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135323.439736:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783135323.439775:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3be35880 x1869752813234688/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135323.439786:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813234688:0@lo:400: 00000100:00080000:0.0:1783135323.439991:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135323.440553:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1869752813234304:12345-0@lo:8: Request processed in 5308us (5382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135323.440564:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783135323.440652:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f10b5fb80 x1869752813234304/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135333 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135323.440679:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783135323.440690:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783135323.440701:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783135323.440707:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783135323.440712:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d108800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783135323.440776:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783135323.440782:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813234304:0@lo:8: 00000100:00100000:3.0:1783135323.441562:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135323.441983:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813234560 00000100:00100000:1.0:1783135323.441991:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813234560 00000100:00100000:1.0:1783135323.442045:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135323.442055:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813234560:12345-0@lo:400: 00000100:00100000:1.0:1783135323.442126:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813234560:12345-0@lo:400: Request processed in 72us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135323.442133:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783135323.442174:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3be34700 x1869752813234560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135323.442187:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813234560:0@lo:400: 00000004:00080000:0.0:1783135323.454932:0:6699:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783135323.455261:0:6699:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 222884444637ns, next at 0ns, rc = 0 00000004:00080000:2.0:1783135323.528733:0:6700:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783135323.528769:0:6700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869752813235200:0@lo:7: 00000100:00100000:2.0:1783135323.529145:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135323.529203:0:6700:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0570ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135323.529728:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813235072:0@lo:13: 00000100:00100000:3.0:1783135323.529787:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135323.532227:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813235200 00000100:00100000:0.0:1783135323.532247:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813235200 00000100:00100000:0.0:1783135323.532338:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135323.532348:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6700:x1869752813235200:12345-0@lo:7: 00000100:00080000:1.0:1783135323.540099:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135323.540138:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813235072 00000100:00100000:1.0:1783135323.540148:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813235072 00000100:00100000:1.0:1783135323.540215:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135323.540228:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869752813235072:12345-0@lo:13: 00002000:00000024:1.0:1783135323.540277:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1783135323.540365:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869752813235072:12345-0@lo:13: Request processed in 140us (10576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135323.540373:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783135323.540434:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3b9ded80 x1869752813235072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135323.540455:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813235072:0@lo:13: 00002000:00080000:0.0:1783135323.543167:0:6590:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1783135323.543176:0:6590:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783135323.543286:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6700:x1869752813235200:12345-0@lo:7: Request processed in 10935us (14137us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135323.543296:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783135323.543388:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3b9dd500 x1869752813235200/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135339 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135323.543403:0:6700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869752813235200:0@lo:7: 00000004:00080000:0.0:1783135323.543418:0:6700:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1783135323.543463:0:6700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869752813235328:0@lo:5: 00000100:00100000:0.0:1783135323.543499:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135323.543537:0:6700:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135323.543554:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813235328 00000100:00100000:0.0:1783135323.543562:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813235328 00000100:00100000:0.0:1783135323.543598:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135323.543606:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6700:x1869752813235328:12345-0@lo:5: 00002000:00080000:0.0:1783135323.543630:0:6587:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783135323.543634:0:6587:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783135323.543884:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6700:x1869752813235328:12345-0@lo:5: Request processed in 278us (385us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783135323.543892:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783135323.543919:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3be34a80 x1869752813235328/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135339 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135323.543930:0:6700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869752813235328:0@lo:5: 00000004:00080000:0.0:1783135323.543938:0:6700:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1783135323.543973:0:6700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be35f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869752813235456:0@lo:700: 00000100:00100000:0.0:1783135323.543998:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135323.544014:0:6700:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf733c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135323.544032:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813235456 00000100:00100000:0.0:1783135323.544035:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813235456 00000100:00100000:0.0:1783135323.544059:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135323.544065:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6700:x1869752813235456:12345-0@lo:700: 00000100:00100000:0.0:1783135323.544092:0:6596:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6596:1869752813235584:0@lo:700: 00000100:00100000:0.0:1783135323.544118:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135323.544137:0:6596:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf73900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135323.544158:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813235584 00000100:00100000:0.0:1783135323.544161:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813235584 00000100:00100000:0.0:1783135323.544190:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135323.544196:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6596:x1869752813235584:12345-0@lo:700: 00000004:00080000:1.0:1783135323.576521:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1783135323.640801:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1783135323.657161:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6596:x1869752813235584:12345-0@lo:700: Request processed in 112960us (113035us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135323.657175:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783135323.657281:0:6596:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3be36d80 x1869752813235584/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783135339 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135323.657296:0:6596:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6596:1869752813235584:0@lo:700: 40000000:02000000:1.0:1783135323.657309:0:6596:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1783135323.778255:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6700:x1869752813235456:12345-0@lo:700: Request processed in 234180us (234245us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135323.778280:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1783135323.778754:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3be35f80 x1869752813235456/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783135339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135323.778772:0:6700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be35f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869752813235456:0@lo:700: 00000001:00080000:3.0:1783135323.780964:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1783135323.780983:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:0.0:1783135323.854071:0:6700:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1783135323.863895:0:6700:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869752813235712:0@lo:5: 00000100:00100000:3.0:1783135323.863961:0:6700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135323.864011:0:6700:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09f30240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135323.867394:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813235712 00000100:00100000:0.0:1783135323.867411:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813235712 00000100:00100000:0.0:1783135323.867492:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135323.867503:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6700:x1869752813235712:12345-0@lo:5: 00002000:00080000:1.0:1783135323.881506:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1783135323.881528:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1783135323.889569:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6700:x1869752813235712:12345-0@lo:5: Request processed in 22060us (25600us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783135323.889593:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783135323.889808:0:6700:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05730000 x1869752813235712/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135339 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135323.889854:0:6700:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1783135323.889869:0:6700:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8f05730000 x1869752813235712/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135339 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135323.889880:0:6700:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6700:1869752813235712:0@lo:5: 00000004:00080000:1.0:1783135323.889893:0:6700:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1783135324.090540:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135325.117229:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135326.138354:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135327.173264:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135328.186260:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135328.735702:0:6960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1783135328.893799:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813235840:0@lo:400: 00000100:00100000:0.0:1783135328.893880:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135328.893922:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135328.893927:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813235968:0@lo:400: 00000100:00100000:0.0:1783135328.893948:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135328.893971:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813236096:0@lo:400: 00000100:00100000:0.0:1783135328.893989:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135328.894002:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135328.894006:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813236224:0@lo:400: 00000100:00100000:0.0:1783135328.894024:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135328.894050:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813235840 00000100:00100000:0.0:1783135328.894057:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813235840 00000100:00100000:0.0:1783135328.894097:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135328.894106:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3311:x1869752813235840:12345-0@lo:400: 00000100:00100000:0.0:1783135328.894166:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3311:x1869752813235840:12345-0@lo:400: Request processed in 61us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135328.894183:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783135328.894218:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813235968 00000100:00100000:0.0:1783135328.894222:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813235968 00000100:00100000:0.0:1783135328.894245:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813236096 00000100:00100000:0.0:1783135328.894248:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813236096 00000100:00100000:3.0:1783135328.894491:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135328.894500:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813235968:12345-0@lo:400: 00000100:00100000:3.0:1783135328.894537:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813235968:12345-0@lo:400: Request processed in 38us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135328.894544:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135328.894559:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135328.894566:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813236352:0@lo:13: 00000100:00100000:3.0:1783135328.894592:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135328.894623:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813236352 00000100:00100000:3.0:1783135328.894627:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813236352 00000100:00100000:3.0:1783135328.894653:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135328.894659:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813236352:12345-0@lo:13: 00002000:00000024:3.0:1783135328.894688:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135328.894724:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813236352:12345-0@lo:13: Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135328.894742:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783135328.894783:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05732a00 x1869752813236352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135328.894801:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813236352:0@lo:13: 00000100:00100000:0.0:1783135328.895650:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135328.895662:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813236096:12345-0@lo:400: 00000100:00100000:0.0:1783135328.895707:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813236096:12345-0@lo:400: Request processed in 49us (1717us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135328.895723:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135328.895748:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813236224 00000100:00100000:0.0:1783135328.895753:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813236224 00000100:00100000:0.0:1783135328.895775:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135328.895780:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813236224:12345-0@lo:400: 00000100:00100000:0.0:1783135328.895807:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813236224:12345-0@lo:400: Request processed in 27us (1782us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135328.895830:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783135328.895860:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3be35f80 x1869752813235968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135328.895872:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813235968:0@lo:400: 00000100:00100000:0.0:1783135328.895882:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813235840:0@lo:400: 00000100:00080000:0.0:1783135328.895902:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135328.895906:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783135328.895920:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3be34700 x1869752813236224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135328.895930:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813236224:0@lo:400: 00010000:00080000:0.0:1783135328.895940:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3be36d80 x1869752813236096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135328.895947:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813236096:0@lo:400: 00000001:00080000:2.0:1783135329.003995:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1783135329.211209:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135330.235372:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135331.258224:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135332.281974:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135333.306051:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135334.012592:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813236480:0@lo:13: 00000100:00100000:3.0:1783135334.012662:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135334.012745:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813236480 00000100:00100000:3.0:1783135334.012754:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813236480 00000100:00100000:3.0:1783135334.012808:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135334.012844:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813236480:12345-0@lo:13: 00002000:00000024:3.0:1783135334.012877:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135334.012919:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813236480:12345-0@lo:13: Request processed in 78us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135334.012926:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1783135334.012948:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135334.012982:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3b9dce00 x1869752813236480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135334.012992:0:3312:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783135334.013011:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813236480:0@lo:13: 00000100:00100000:0.0:1783135334.015201:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813236608:0@lo:400: 00000100:00100000:0.0:1783135334.015279:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135334.015723:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813236736:0@lo:400: 00000100:00100000:1.0:1783135334.015759:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135334.015923:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813236736 00000100:00100000:2.0:1783135334.015931:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813236736 00000100:00100000:2.0:1783135334.015982:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135334.015991:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813236736:12345-0@lo:400: 00000100:00100000:2.0:1783135334.016046:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813236736:12345-0@lo:400: Request processed in 57us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135334.016054:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783135334.016126:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05730700 x1869752813236736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135334.016137:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813236736:0@lo:400: 00000100:00100000:0.0:1783135334.016880:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813236608 00000100:00100000:0.0:1783135334.016889:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813236608 00000100:00100000:0.0:1783135334.016928:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135334.016935:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3313:x1869752813236608:12345-0@lo:400: 00000100:00100000:0.0:1783135334.016986:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3313:x1869752813236608:12345-0@lo:400: Request processed in 51us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135334.016992:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135334.017031:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813236608:0@lo:400: 00000100:00100000:3.0:1783135334.022729:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135334.022756:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813236864:0@lo:400: 00000100:00100000:3.0:1783135334.022848:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135334.022890:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813236864 00000100:00100000:3.0:1783135334.022912:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813236864 00000100:00100000:3.0:1783135334.022965:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135334.022975:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813236864:12345-0@lo:400: 00000100:00100000:3.0:1783135334.023028:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813236864:12345-0@lo:400: Request processed in 54us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135334.023036:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1783135334.023057:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783135334.023096:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05731880 x1869752813236864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135334.023110:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813236864:0@lo:400: 00010000:00010000:1.0:1783135334.330113:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135335.357108:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135336.378396:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135337.401966:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135338.426954:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135339.130808:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813236992:0@lo:13: 00000100:00100000:1.0:1783135339.130932:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135339.132887:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813236992 00000100:00100000:3.0:1783135339.132902:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813236992 00000100:00100000:3.0:1783135339.132974:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135339.132986:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813236992:12345-0@lo:13: 00002000:00000024:3.0:1783135339.133039:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135339.134988:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813237120:0@lo:400: 00000100:00100000:2.0:1783135339.135125:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135339.135188:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135339.135196:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813237248:0@lo:400: 00000100:00100000:2.0:1783135339.135225:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135339.135388:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813237376:0@lo:400: 00000100:00100000:2.0:1783135339.135422:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135339.135457:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813237248 00000100:00100000:2.0:1783135339.135465:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813237248 00000100:00100000:2.0:1783135339.135517:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813237376 00000100:00100000:2.0:1783135339.135520:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813237376 00000100:00100000:2.0:1783135339.135545:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135339.135554:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813237248:12345-0@lo:400: 00000100:00100000:2.0:1783135339.135613:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813237248:12345-0@lo:400: Request processed in 60us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135339.135620:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135339.135640:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135339.135647:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813237376:12345-0@lo:400: 00000100:00100000:2.0:1783135339.135678:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813237376:12345-0@lo:400: Request processed in 31us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135339.135684:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1783135339.135913:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3b9dea00 x1869752813237248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135339.135929:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813237248:0@lo:400: 00010000:00080000:2.0:1783135339.135957:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3b9dc000 x1869752813237376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135339.135966:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813237376:0@lo:400: 00000100:00080000:2.0:1783135339.138849:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135339.138862:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135339.139518:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813237120 00000100:00100000:0.0:1783135339.139531:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813237120 00000100:00100000:0.0:1783135339.139579:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135339.139589:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3313:x1869752813237120:12345-0@lo:400: 00000100:00100000:0.0:1783135339.140608:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3313:x1869752813237120:12345-0@lo:400: Request processed in 1015us (5478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135339.141114:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783135339.141730:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813237120:0@lo:400: 00000100:00100000:3.0:1783135339.146461:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813236992:12345-0@lo:13: Request processed in 13450us (15501us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135339.146489:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1783135339.146495:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05731880 x1869752813236992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135339.146559:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813236992:0@lo:13: 00010000:00010000:2.0:1783135339.451021:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783135339.894549:0:7476:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783135339.894557:0:7476:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783135339.895010:0:7476:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8e0182b800 00000020:01000004:2.0:1783135339.895031:0:7476:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1783135339.895046:0:7476:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783135339.895064:0:7476:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e8f3fc34d40) 00000020:00000080:2.0:1783135339.895165:0:7476:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783135339.913629:0:7476:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783135339.914009:0:7476:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1783135339.952229:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1783135339.959537:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783135339.959574:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1783135339.959635:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783135339.959662:0:7476:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1783135339.960113:0:7476:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783135339.960127:0:7476:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135339.960139:0:7476:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf646e0cda875c7a6 00000020:01000004:3.0:1783135339.960148:0:7476:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783135339.960169:0:7476:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783135339.960173:0:7476:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783135339.960179:0:7476:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783135339.960200:0:7476:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783135339.960204:0:7476:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783135339.996318:0:7476:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783135339.996360:0:7476:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.160@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1783135339.996364:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783135339.996365:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135339.996367:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135339.996368:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135339.996369:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135339.996371:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135339.996372:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135339.996373:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783135339.996375:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783135339.996376:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135339.996377:0:7476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783135339.996381:0:7476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1783135339.996383:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783135339.996384:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135339.996385:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135339.996390:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783135339.996391:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135339.996392:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135339.996392:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135339.996393:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783135339.996394:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783135339.996395:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135339.996396:0:7476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783135339.996424:0:7476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783135339.996445:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813237504:0@lo:253: 00000100:00100000:0.0:1783135339.996533:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135339.996578:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d000 going to sleep for 11 seconds 00000100:00100000:1.0:1783135339.996675:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813237504 00000100:00100000:1.0:1783135339.996683:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813237504 00000100:00100000:1.0:1783135339.996735:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135339.996744:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:7476:x1869752813237504:12345-0@lo:253: 20000000:01000000:1.0:1783135339.996773:0:5789:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783135339.996778:0:5789:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1783135339.996783:0:5789:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1783135339.996786:0:5789:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1783135339.997655:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135339.997890:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1783135339.997905:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1783135339.997941:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1783135339.997948:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1783135339.997974:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1783135339.998038:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1783135339.998385:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1783135339.998406:0:5789:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.160@tcp 20000000:01000000:1.0:1783135339.998409:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.160@tcp (null) (null) (null) 00000040:00080000:1.0:1783135339.998439:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1783135339.998446:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783135339.998487:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1783135339.998494:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.160@tcp (null) (null) 00000040:00080000:1.0:1783135339.998534:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1783135339.998543:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783135339.998573:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1783135339.998633:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1783135339.999362:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1783135339.999377:0:5789:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.160@tcp 20000000:01000000:1.0:1783135339.999379:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.160@tcp (null) (null) (null) 00000040:00080000:1.0:1783135339.999412:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1783135339.999420:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1783135339.999452:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1783135339.999460:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.160@tcp (null) (null) 00000040:00080000:1.0:1783135339.999490:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1783135339.999499:0:5789:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783135339.999541:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1783135339.999578:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1783135339.999593:0:5789:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783135339.999596:0:5789:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783135339.999600:0:5789:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783135339.999614:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783135339.999617:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783135339.999648:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1783135339.999650:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1783135340.004410:0:7478:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1783135340.004515:0:7478:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1783135340.004576:0:7478:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1783135340.005267:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1783135340.005444:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1783135340.005483:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1783135340.005497:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1783135340.005500:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783135340.006511:0:7479:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1783135340.006591:0:7479:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1783135340.006624:0:7479:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1783135340.007043:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1783135340.007228:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1783135340.008207:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1783135340.008230:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1783135340.008233:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783135340.014771:0:7480:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1783135340.015193:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1783135340.015246:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1783135340.015525:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1783135340.015540:0:5789:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1783135340.015543:0:5789:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783135340.016229:0:7481:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1783135340.016419:0:7481:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1783135340.016482:0:7481:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1783135340.017035:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1783135340.017096:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1783135340.017157:0:5789:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1783135340.017176:0:5789:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1783135340.017178:0:5789:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1783135340.017189:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783135340.017208:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017226:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017235:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c721 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017241:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c74b expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017248:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c767 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017253:0:5789:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c791 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017261:0:5789:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017492:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c791 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017509:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c791 expref: 16 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.017538:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813237632:0@lo:104: 00000100:00100000:1.0:1783135340.017607:0:5789:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135340.017659:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c767 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017668:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c767 expref: 16 pid: 5789 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.017676:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813237760:0@lo:104: 00010000:00010000:1.0:1783135340.017698:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c74b expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017706:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c74b expref: 16 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.017713:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813237888:0@lo:104: 00010000:00010000:1.0:1783135340.017735:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c721 expref: 16 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017742:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c721 expref: 16 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.017750:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813238016:0@lo:104: 00010000:00010000:1.0:1783135340.017773:0:5789:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 16 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.017781:0:5789:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 16 pid: 5787 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.017802:0:5789:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813238144:0@lo:104: 00000100:00100000:1.0:1783135340.017856:0:5789:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135340.018032:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1783135340.018050:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.018193:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.020633:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.020712:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813237632 00000100:00100000:2.0:1783135340.020721:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813237632 00000100:00100000:2.0:1783135340.020765:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813237760 00000100:00100000:2.0:1783135340.020768:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813237760 00000100:00100000:2.0:1783135340.020779:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813237888 00000100:00100000:2.0:1783135340.020782:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813237888 00000100:00100000:2.0:1783135340.020795:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135340.020804:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:5789:x1869752813237632:12345-0@lo:104: 00010000:00010000:2.0:1783135340.020910:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.021109:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813237632:0@lo:104: 00010000:00010000:2.0:1783135340.021267:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135340.021275:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02cd0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:5789:x1869752813237632:12345-0@lo:104: Request processed in 472us (3668us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135340.021412:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135340.021455:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783135340.021463:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:5789:x1869752813237760:12345-0@lo:104: 00010000:00010000:2.0:1783135340.021482:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135340.021583:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.021594:0:5779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783135340.021601:0:5779:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:1.0:1783135340.021740:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813237760:0@lo:104: 00010000:00010000:3.0:1783135340.021774:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135340.021782:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.021790:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42156000 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135340.021793:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.021802:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135340.021810:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135340.024366:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813238016 00000100:00100000:0.0:1783135340.024377:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813238016 00000100:00100000:0.0:1783135340.024421:0:5779:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783135340.024430:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813238144 00000100:00100000:0.0:1783135340.024433:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813238144 00000100:00100000:0.0:1783135340.024509:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135340.024519:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+6:5789:x1869752813237888:12345-0@lo:104: 00010000:00010000:0.0:1783135340.024551:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.024649:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1783135340.024657:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+6:5789:x1869752813237888:12345-0@lo:104: Request processed in 139us (6462us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.024664:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135340.024685:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135340.024692:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:5789:x1869752813238016:12345-0@lo:104: 00010000:00010000:0.0:1783135340.024700:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.024732:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1783135340.024737:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:5789:x1869752813238016:12345-0@lo:104: Request processed in 47us (4116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.024743:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135340.024760:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135340.024766:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:5789:x1869752813238144:12345-0@lo:104: 00010000:00010000:0.0:1783135340.024773:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.024800:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1783135340.024805:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:5789:x1869752813238144:12345-0@lo:104: Request processed in 40us (3222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.024811:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 10000000:01000000:3.0:1783135340.026258:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135340.026330:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026338:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135340.026375:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026382:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42156000/0xf646e0cda875c791 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c798 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026402:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1783135340.026405:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026412:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f00031e00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135340.026415:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026424:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135340.026430:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135340.026436:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135340.026450:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026455:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135340.026469:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026474:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c767 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c76e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026485:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783135340.026493:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026498:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f029c9000 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135340.026501:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026508:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135340.026513:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135340.026519:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135340.026533:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026539:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135340.026544:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026551:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9000/0xf646e0cda875c74b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c752 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026561:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135340.026564:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026570:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42157800 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135340.026572:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026589:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135340.026595:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135340.026600:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135340.026612:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026617:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135340.026622:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026627:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c721 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c728 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026636:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135340.026639:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026644:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f029c9a00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135340.026646:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026652:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135340.026658:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135340.026668:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1783135340.026680:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026685:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783135340.026689:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026694:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f029c9a00/0xf646e0cda875c6f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6fe expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.026708:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135340.026710:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135340.026712:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135340.026738:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813238272:0@lo:103: 00000100:00100000:3.0:1783135340.026795:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.026862:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813238784:0@lo:103: 00000100:00100000:3.0:1783135340.026881:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.026902:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135340.026907:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813238656:0@lo:103: 00000100:00100000:3.0:1783135340.026927:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.026954:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813238400:0@lo:103: 00000100:00100000:3.0:1783135340.026973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.027004:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135340.027010:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813238528:0@lo:103: 00000100:00100000:3.0:1783135340.027029:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.027056:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813238272 00000100:00100000:3.0:1783135340.027069:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813238272 00010000:00010000:3.0:1783135340.027110:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c791 expref: 17 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135340.027131:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813238784 00000100:00100000:3.0:1783135340.027134:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813238784 00010000:00010000:3.0:1783135340.027144:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 18 pid: 5787 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135340.027154:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813238656 00000100:00100000:3.0:1783135340.027156:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813238656 00010000:00010000:3.0:1783135340.027164:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c721 expref: 19 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135340.027172:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813238400 00000100:00100000:3.0:1783135340.027173:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813238400 00010000:00010000:3.0:1783135340.027181:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c767 expref: 20 pid: 5789 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135340.027189:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813238528 00000100:00100000:3.0:1783135340.027190:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813238528 00010000:00010000:3.0:1783135340.027198:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c74b expref: 21 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135340.027209:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135340.027216:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+21:3312:x1869752813238272:12345-0@lo:103: 00010000:00010000:3.0:1783135340.027229:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135340.027233:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c791 expref: 21 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027243:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c791 expref: 21 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027269:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c798 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c791 expref: 21 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027284:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135340.027317:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+20:3312:x1869752813238272:12345-0@lo:103: Request processed in 100us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.027323:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135340.027340:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135340.027346:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813238784:12345-0@lo:103: 00010000:00010000:3.0:1783135340.027354:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135340.027358:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 19 pid: 5787 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027366:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 19 pid: 5787 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027375:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135340.027393:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813238784:12345-0@lo:103: Request processed in 48us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.027399:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135340.027409:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135340.027414:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:3312:x1869752813238656:12345-0@lo:103: 00010000:00010000:3.0:1783135340.027422:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135340.027426:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c721 expref: 18 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027432:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c721 expref: 18 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027448:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135340.027469:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:3312:x1869752813238656:12345-0@lo:103: Request processed in 55us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.027474:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135340.027485:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135340.027491:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:3313:x1869752813238400:12345-0@lo:103: 00010000:00010000:3.0:1783135340.027497:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135340.027502:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c767 expref: 17 pid: 5789 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027510:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c767 expref: 17 pid: 5789 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027519:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b3600/0xf646e0cda875c76e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c767 expref: 17 pid: 5789 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027527:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135340.027549:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3313:x1869752813238400:12345-0@lo:103: Request processed in 59us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.027555:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783135340.027565:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135340.027570:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:3313:x1869752813238528:12345-0@lo:103: 00010000:00010000:3.0:1783135340.027576:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135340.027580:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c74b expref: 15 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027588:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c74b expref: 15 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027608:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027617:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027630:0:6604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027637:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027644:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027650:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027656:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42157600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135340.027659:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027666:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027674:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.027682:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135340.027705:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:3313:x1869752813238528:12345-0@lo:103: Request processed in 134us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.027718:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135340.027761:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813238656:0@lo:103: 00000100:00100000:3.0:1783135340.027770:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813238272:0@lo:103: 00000100:00100000:3.0:1783135340.027777:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813238784:0@lo:103: 00000100:00100000:3.0:1783135340.027804:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813238528:0@lo:103: 00000100:00100000:3.0:1783135340.027810:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813238400:0@lo:103: 00010000:00010000:1.0:1783135340.028414:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b3800/0xf646e0cda875c752 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c74b expref: 14 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.028426:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813237888:0@lo:104: 00010000:00010000:1.0:1783135340.028437:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f029c8a00/0xf646e0cda875c728 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c721 expref: 13 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.028445:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5e680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813238016:0@lo:104: 00010000:00010000:1.0:1783135340.028455:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c6fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c6f7 expref: 12 pid: 5787 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.028467:0:5789:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5789:1869752813238144:0@lo:104: 00010000:00010000:1.0:1783135340.028494:0:5789:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.028504:0:5789:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.028510:0:5789:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.028516:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c7ad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783135340.028546:0:5789:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:2.0:1783135340.028680:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1783135340.028688:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5789:x1869752813237760:12345-0@lo:104: Request processed in 7226us (10637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135340.028697:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:2.0:1783135340.028721:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135340.028727:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135340.029446:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135340.116966:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:7476:x1869752813237504:12345-0@lo:253: Request processed in 120212us (120422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.116992:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783135340.117200:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813237504:0@lo:253: 10000000:01000000:0.0:1783135340.117216:0:7476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783135340.117232:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783135340.117233:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783135340.117235:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783135340.117236:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1783135340.117237:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783135340.117238:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783135340.117240:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783135340.117241:0:7476:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783135340.117243:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783135340.117244:0:7476:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783135340.117266:0:7476:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8e0182b800 from lustre-OST0001 10000000:01000000:0.0:1783135340.117308:0:7476:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783135340.117312:0:7476:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783135340.117319:0:7476:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8f062a19c0 local copy 10000000:01000000:0.0:1783135340.117323:0:7476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783135340.117359:0:7476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.117370:0:7476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.117379:0:7476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135340.117397:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813238912:0@lo:101: 00000100:00100000:0.0:1783135340.117433:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.117481:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135340.117608:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813238912 00000100:00100000:2.0:1783135340.117615:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813238912 00000100:00100000:2.0:1783135340.117662:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783135340.117671:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+11:7476:x1869752813238912:12345-0@lo:101: 00010000:00010000:2.0:1783135340.117683:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135340.117696:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b2a00/0xf646e0cda875c7bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c7b4 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.117719:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b2a00/0xf646e0cda875c7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c7b4 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.117729:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b2a00/0xf646e0cda875c7bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c7b4 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.117738:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2a00, rc 0) 00000100:00100000:2.0:1783135340.117766:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813238912:12345-0@lo:101: Request processed in 97us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135340.117771:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783135340.117848:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813238912:0@lo:101: 00010000:00010000:0.0:1783135340.117860:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.117868:0:7476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135340.117987:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239040:0@lo:501: 00000100:00100000:0.0:1783135340.118029:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.118058:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135340.118163:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813239040 00000100:00100000:2.0:1783135340.118168:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813239040 00000100:00100000:2.0:1783135340.118197:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1783135340.118203:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239040:12345-0@lo:501: 00000100:00100000:2.0:1783135340.118405:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239040:12345-0@lo:501: Request processed in 201us (374us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135340.118412:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783135340.118531:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239040:0@lo:501: 10000000:01000000:0.0:1783135340.118544:0:7476:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783135340.118572:0:7476:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783135340.118577:0:7476:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118585:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118592:0:7476:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118616:0:7476:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783135340.118636:0:7476:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8e0182b800 10000000:01000000:0.0:1783135340.118640:0:7476:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783135340.118645:0:7476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783135340.118648:0:7476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783135340.118652:0:7476:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783135340.118654:0:7476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783135340.118671:0:7476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118678:0:7476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118699:0:7476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135340.118711:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239168:0@lo:101: 00000100:00100000:0.0:1783135340.118738:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.118752:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135340.118766:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813239168 00000100:00100000:0.0:1783135340.118770:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813239168 00000100:00100000:0.0:1783135340.118795:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783135340.118800:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239168:12345-0@lo:101: 00010000:00010000:0.0:1783135340.118807:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135340.118845:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c7c2 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118862:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118870:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118877:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05220400, rc 0) 00000100:00100000:0.0:1783135340.118904:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813239168:12345-0@lo:101: Request processed in 103us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.118909:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783135340.118943:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239168:0@lo:101: 00010000:00010000:0.0:1783135340.118953:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.118971:0:7476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135340.119034:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239296:0@lo:501: 00000100:00100000:0.0:1783135340.119058:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.119136:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d0c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783135340.119203:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135340.119209:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.119216:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05220e00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135340.119219:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.119228:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135340.119234:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135340.119239:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783135340.119257:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.119263:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135340.119360:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.119368:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05220e00/0xf646e0cda875c7b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xf646e0cda875c7bb expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.119394:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135340.119396:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135340.119398:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135340.119409:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813239296 00000100:00100000:2.0:1783135340.119413:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813239296 00000100:00100000:2.0:1783135340.119434:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135340.119441:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813239296:12345-0@lo:501: 00000100:00100000:2.0:1783135340.119624:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813239296:12345-0@lo:501: Request processed in 182us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135340.119631:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783135340.119777:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813239424:0@lo:103: 00000100:00100000:0.0:1783135340.119808:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.119898:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239296:0@lo:501: 00000100:00100000:0.0:1783135340.119926:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239552:0@lo:503: 00000100:00100000:0.0:1783135340.119963:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.119989:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135340.120003:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813239552 00000100:00100000:0.0:1783135340.120008:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813239552 00000100:00100000:0.0:1783135340.120033:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783135340.120038:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813239552:12345-0@lo:503: 00000100:00100000:2.0:1783135340.120181:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813239424 00000100:00100000:2.0:1783135340.120186:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813239424 00000100:00100000:2.0:1783135340.120221:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135340.120228:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:3313:x1869752813239424:12345-0@lo:103: 00010000:00010000:2.0:1783135340.120237:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135340.120252:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b2a00/0xf646e0cda875c7bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c7b4 expref: 14 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.120265:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135340.120432:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:3313:x1869752813239424:12345-0@lo:103: Request processed in 204us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135340.120439:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135340.120635:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239552:12345-0@lo:503: Request processed in 595us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.120642:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783135340.120686:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813239424:0@lo:103: 00000100:00100000:2.0:1783135340.120757:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239552:0@lo:503: 00000040:00080000:2.0:1783135340.121068:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135340.121202:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239680:0@lo:502: 00000100:00100000:2.0:1783135340.121247:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.121486:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f39655f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135340.121547:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813239680 00000100:00100000:0.0:1783135340.121553:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813239680 00000100:00100000:0.0:1783135340.121631:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135340.121641:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239680:12345-0@lo:502: 00000100:00100000:0.0:1783135340.121838:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239680:12345-0@lo:502: Request processed in 173us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.121846:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783135340.121927:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239680:0@lo:502: 00000040:00080000:2.0:1783135340.122229:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783135340.122593:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783135340.122639:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783135340.122694:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783135340.122732:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783135340.122766:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783135340.122795:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239808:0@lo:502: 00000100:00100000:2.0:1783135340.122873:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.123051:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f39655f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135340.123178:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813239808 00000100:00100000:1.0:1783135340.123186:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813239808 00000100:00100000:1.0:1783135340.123222:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1783135340.123230:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239808:12345-0@lo:502: 00000100:00100000:1.0:1783135340.123428:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239808:12345-0@lo:502: Request processed in 198us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.123436:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783135340.123645:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239808:0@lo:502: 00000040:00080000:2.0:1783135340.123739:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783135340.123749:0:7476:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1783135340.124541:0:7485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783135340.124551:0:7485:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1783135340.124559:0:7485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135340.124561:0:7485:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1783135340.124567:0:7485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783135340.124585:0:7485:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e8f3fc30000) 00000020:00000080:2.0:1783135340.124609:0:7485:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783135340.124615:0:7485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783135340.124703:0:7485:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8e0182b800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1783135340.124711:0:7485:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783135340.124718:0:7485:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf646e0cda875c7d7 00010000:00010000:2.0:1783135340.129461:0:7485:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1783135340.129801:0:7485:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1783135340.133236:0:7485:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1783135340.133693:0:7485:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1783135340.138691:0:7485:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1783135340.139693:0:7485:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1783135340.141260:0:7485:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1783135340.141271:0:7485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135340.141409:0:7485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135340.141412:0:7485:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1783135340.141416:0:7485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135340.141421:0:7485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135340.141422:0:7485:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783135340.141426:0:7485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783135340.141427:0:7485:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783135340.141474:0:7485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135340.141478:0:7485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135340.141479:0:7485:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783135340.141482:0:7485:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783135340.141686:0:7476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1783135340.141715:0:7476:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783135340.141741:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.141752:0:7476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135340.141761:0:7476:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8e0182b800 from 1 10000000:01000000:2.0:1783135340.141764:0:7476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135340.141806:0:7476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.141851:0:7476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.141862:0:7476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135340.141885:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239936:0@lo:101: 00000100:00100000:2.0:1783135340.141963:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.142011:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c15c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135340.142181:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813239936 00000100:00100000:3.0:1783135340.142190:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813239936 00000100:00100000:3.0:1783135340.142241:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783135340.142251:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:7476:x1869752813239936:12345-0@lo:101: 00010000:00010000:3.0:1783135340.142265:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135340.142398:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c7de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.142426:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c7de expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.142438:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c7de expref: 13 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.142446:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486400, rc 0) 00000100:00100000:3.0:1783135340.142508:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813239936:12345-0@lo:101: Request processed in 257us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.142515:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783135340.142604:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813239936:0@lo:101: 00010000:00010000:2.0:1783135340.142618:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135340.142627:0:7476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135340.142707:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240064:0@lo:501: 00000100:00100000:2.0:1783135340.142751:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.142771:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c15c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135340.142836:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813240064 00000100:00100000:1.0:1783135340.142840:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813240064 00000100:00100000:1.0:1783135340.142866:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1783135340.142872:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240064:12345-0@lo:501: 00000100:00100000:1.0:1783135340.143151:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240064:12345-0@lo:501: Request processed in 278us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.143165:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783135340.143260:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240064:0@lo:501: 00000100:00100000:2.0:1783135340.143417:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240192:0@lo:503: 00000100:00100000:2.0:1783135340.143457:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.143480:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c15c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135340.143543:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813240192 00000100:00100000:3.0:1783135340.143549:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813240192 00000100:00100000:3.0:1783135340.143583:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783135340.143591:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240192:12345-0@lo:503: 00000100:00100000:3.0:1783135340.143926:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240192:12345-0@lo:503: Request processed in 334us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.143933:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783135340.144270:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240192:0@lo:503: 00000040:00080000:2.0:1783135340.144847:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135340.144920:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240320:0@lo:502: 00000100:00100000:2.0:1783135340.144974:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.145012:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c15c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135340.145489:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813240320 00000100:00100000:3.0:1783135340.145497:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813240320 00000100:00100000:3.0:1783135340.145543:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1783135340.145551:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240320:12345-0@lo:502: 00000100:00100000:3.0:1783135340.145764:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240320:12345-0@lo:502: Request processed in 213us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.145770:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783135340.147381:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240320:0@lo:502: 00000040:00080000:2.0:1783135340.147741:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1783135340.147806:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1783135340.147867:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240448:0@lo:502: 00000100:00100000:2.0:1783135340.147936:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.147974:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c15c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135340.150448:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813240448 00000100:00100000:1.0:1783135340.150461:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813240448 00000100:00100000:1.0:1783135340.150516:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783135340.150527:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240448:12345-0@lo:502: 00000100:00100000:1.0:1783135340.150769:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240448:12345-0@lo:502: Request processed in 243us (2831us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.150777:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1783135340.150864:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240448:0@lo:502: 00000040:00080000:1.0:1783135340.151053:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783135340.151201:0:7476:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783135340.157490:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135340.157505:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135340.157508:0:7488:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783135340.157515:0:7488:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8e0182b800 00000020:00000080:2.0:1783135340.157517:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135340.157539:0:7488:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135340.157542:0:7488:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135340.157543:0:7488:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783135340.157546:0:7488:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1783135340.158367:0:7476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1783135340.158399:0:7476:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135340.158425:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.158440:0:7476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135340.158499:0:7476:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783135340.158502:0:7476:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8e0182b800 10000000:01000000:1.0:1783135340.158505:0:7476:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8e0182b800 10000000:01000000:1.0:1783135340.158509:0:7476:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135340.158516:0:7476:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8e0182b800 from 1 10000000:01000000:1.0:1783135340.158519:0:7476:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135340.158567:0:7476:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.158592:0:7476:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.158604:0:7476:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.158632:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240576:0@lo:101: 00000100:00100000:1.0:1783135340.158708:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135340.158747:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135340.158772:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813240576 00000100:00100000:1.0:1783135340.158779:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813240576 00000100:00100000:1.0:1783135340.158879:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783135340.158889:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813240576:12345-0@lo:101: 00010000:00010000:1.0:1783135340.158905:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135340.158919:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c7ec expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.158947:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.158959:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.158969:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42156400, rc 0) 00000100:00100000:1.0:1783135340.159022:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813240576:12345-0@lo:101: Request processed in 134us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.159029:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1783135340.163236:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240576:0@lo:101: 00010000:00010000:1.0:1783135340.165397:0:7476:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.165422:0:7476:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.165620:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240704:0@lo:501: 00000100:00100000:1.0:1783135340.165687:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135340.165736:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135340.168430:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813240704 00000100:00100000:3.0:1783135340.168445:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813240704 00000100:00100000:3.0:1783135340.168536:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783135340.168547:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813240704:12345-0@lo:501: 00000100:00100000:3.0:1783135340.168874:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813240704:12345-0@lo:501: Request processed in 328us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.168882:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1783135340.168988:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240704:0@lo:501: 00000100:00100000:2.0:1783135340.169049:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240832:0@lo:503: 00000100:00100000:2.0:1783135340.169111:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.173722:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c15ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135340.179234:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813240832 00000100:00100000:1.0:1783135340.179251:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813240832 00000100:00100000:1.0:1783135340.179337:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135340.179350:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813240832:12345-0@lo:503: 00000100:00100000:1.0:1783135340.179660:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813240832:12345-0@lo:503: Request processed in 311us (10547us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.179668:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783135340.182184:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240832:0@lo:503: 00000040:00080000:2.0:1783135340.182548:0:7476:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135340.182629:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240960:0@lo:502: 00000100:00100000:2.0:1783135340.182713:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.182758:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c15ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135340.183589:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813240960 00000100:00100000:1.0:1783135340.183597:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813240960 00000100:00100000:1.0:1783135340.183647:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783135340.183657:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813240960:12345-0@lo:502: 00000100:00100000:1.0:1783135340.184096:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813240960:12345-0@lo:502: Request processed in 439us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.184104:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783135340.184271:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813240960:0@lo:502: 00000040:00080000:2.0:1783135340.184569:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1783135340.184623:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783135340.184654:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783135340.184729:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783135340.184770:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783135340.184856:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783135340.184896:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783135340.184930:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783135340.184986:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783135340.185025:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783135340.185060:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783135340.185111:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783135340.185145:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783135340.185178:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783135340.185243:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783135340.185278:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783135340.185312:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1783135340.185359:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783135340.185396:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783135340.185444:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783135340.185498:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783135340.185527:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783135340.185553:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783135340.185591:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783135340.185619:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1783135340.185646:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1783135340.185684:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1783135340.185717:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1783135340.185750:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1783135340.185796:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1783135340.185881:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1783135340.185914:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1783135340.185940:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1783135340.185990:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1783135340.186027:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1783135340.186091:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1783135340.186125:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1783135340.186168:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813241088:0@lo:502: 00000100:00100000:2.0:1783135340.186241:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.186280:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c15ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135340.186605:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813241088 00000100:00100000:1.0:1783135340.186612:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813241088 00000100:00100000:1.0:1783135340.186660:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783135340.186669:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813241088:12345-0@lo:502: 00000100:00100000:1.0:1783135340.186914:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813241088:12345-0@lo:502: Request processed in 246us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.186921:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783135340.188122:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813241088:0@lo:502: 00000040:00080000:2.0:1783135340.188252:0:7476:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1783135340.188266:0:7476:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1783135340.189507:0:7490:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1783135340.189652:0:7490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e8f053919c0) 00000020:00000080:3.0:1783135340.189677:0:7490:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1783135340.193712:0:7490:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8e0182b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783135340.193735:0:7490:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8e0182b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1783135340.193739:0:7490:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8e0182b800 3 00010000:00080000:3.0:1783135340.193796:0:7490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8f3c430800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.160@tcp at head 00010000:00010000:3.0:1783135340.196754:0:7490:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1783135340.196999:0:7490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783135340.197068:0:7490:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135340.197084:0:7490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf646e0cda875c801 00000100:00080000:3.0:1783135340.197097:0:7490:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135340.197104:0:7490:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8f3c430800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:3.0:1783135340.197145:0:7490:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f05733480 x1869752813241216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135340.197194:0:7490:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783135340.198416:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1869752813241216:0@lo:38: 00000100:00100000:0.0:1783135340.198492:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135340.198559:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813241216 00000100:00100000:0.0:1783135340.198565:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813241216 00000100:00100000:0.0:1783135340.198598:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135340.198605:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3310:x1869752813241216:12345-0@lo:38: 00010000:00080000:0.0:1783135340.198629:0:5795:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:0.0:1783135340.198661:0:5795:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf646e0cda875c808 00000004:00100000:0.0:1783135340.198676:0:5795:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783135340.198707:0:5795:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d109800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135340.198759:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869752813241216:12345-0@lo:38: Request processed in 152us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.198766:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1783135340.198811:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05733480 x1869752813241216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135340.198852:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135340.198859:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1783135340.198867:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783135340.198872:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783135340.198874:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c430800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135340.198880:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1869752813241216:0@lo:38: 00000100:00100000:2.0:1783135340.199417:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135340.202879:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813241344:0@lo:400: 00000100:00100000:1.0:1783135340.202957:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135340.203032:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813241344 00000100:00100000:1.0:1783135340.203040:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813241344 00000100:00100000:1.0:1783135340.203084:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135340.203092:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813241344:12345-0@lo:400: 00000100:00100000:1.0:1783135340.203153:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813241344:12345-0@lo:400: Request processed in 61us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.203161:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1783135340.203211:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05731880 x1869752813241344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135340.203227:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813241344:0@lo:400: 00000100:00100000:2.0:1783135340.205117:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813241600:0@lo:400: 00000100:00100000:2.0:1783135340.205183:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135340.205226:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813241472:0@lo:400: 00000100:00100000:2.0:1783135340.205250:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135340.205426:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813241600 00000100:00100000:1.0:1783135340.205435:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813241600 00000100:00100000:1.0:1783135340.205483:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135340.205491:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813241600:12345-0@lo:400: 00000100:00100000:0.0:1783135340.205657:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813241472 00000100:00100000:0.0:1783135340.205669:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813241472 00000100:00100000:0.0:1783135340.205703:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783135340.205709:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813241472:12345-0@lo:400: 00000100:00100000:1.0:1783135340.205807:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813241600:12345-0@lo:400: Request processed in 316us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135340.205836:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783135340.205995:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05730a80 x1869752813241600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135340.206022:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813241600:0@lo:400: 00000100:00100000:3.0:1783135340.206455:0:7492:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7492:1869752813241728:0@lo:901: 00000100:00100000:3.0:1783135340.206510:0:7492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.206539:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813241728 00000100:00100000:3.0:1783135340.206544:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813241728 00000100:00100000:3.0:1783135340.206582:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135340.206589:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7492:x1869752813241728:12345-0@lo:901: 00000100:00100000:3.0:1783135340.206950:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7492:x1869752813241728:12345-0@lo:901: Request processed in 360us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.206958:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1783135340.206989:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135340.207018:0:7492:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3db37d80 going to sleep for 11 seconds 00010000:00080000:3.0:1783135340.207035:0:7492:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05730000 x1869752813241728/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783135356 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135340.207045:0:7492:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7492:1869752813241728:0@lo:901: 00000040:00080000:1.0:1783135340.207664:0:7490:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:0.0:1783135340.207833:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813241472:12345-0@lo:400: Request processed in 2102us (2559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.207842:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000020:01000000:3.0:1783135340.208567:0:7476:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1783135340.208598:0:7476:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135340.208617:0:7476:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.208626:0:7476:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783135340.208661:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783135340.208663:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135340.208664:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135340.208665:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135340.208666:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135340.208668:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135340.208669:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135340.208671:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135340.208672:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135340.208674:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135340.208676:0:7476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135340.208680:0:7476:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1783135340.208682:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135340.208683:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135340.208685:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135340.208686:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135340.208687:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135340.208688:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135340.208689:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135340.208690:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135340.208691:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135340.208693:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135340.208694:0:7476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135340.208717:0:7476:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783135340.208734:0:7476:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813241856:0@lo:253: 00000100:00100000:3.0:1783135340.208790:0:7476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.208850:0:7476:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0826cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135340.208950:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813241856 00000100:00100000:0.0:1783135340.208959:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813241856 00000100:00100000:0.0:1783135340.209017:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1783135340.209025:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7476:x1869752813241856:12345-0@lo:253: 20000000:01000000:0.0:1783135340.209056:0:5788:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783135340.209128:0:5788:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1783135340.209899:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f05730700 x1869752813241472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135340.209914:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813241472:0@lo:400: 20000000:01000000:0.0:1783135340.231891:0:5788:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783135340.231915:0:5788:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783135340.232187:0:5810:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783135340.232195:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783135340.232240:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.232264:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c759 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.232273:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.232332:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c759 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.232349:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c759 expref: 14 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135340.232364:0:5810:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869752813241984:0@lo:104: 00000100:00100000:3.0:1783135340.232438:0:5810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.232485:0:5810:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135340.232888:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813241984 00000100:00100000:0.0:1783135340.232896:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813241984 00000100:00100000:0.0:1783135340.232949:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135340.232958:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5810:x1869752813241984:12345-0@lo:104: 00010000:00010000:0.0:1783135340.232970:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.233033:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135340.233039:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:5810:x1869752813241984:12345-0@lo:104: Request processed in 83us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135340.233046:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1783135340.233072:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135340.233078:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.233099:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f00031600 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:0.0:1783135340.233103:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.233112:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135340.233119:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135340.233125:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135340.233152:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.233159:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135340.233175:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.233182:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c759 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c760 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135340.233201:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135340.233203:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135340.233205:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135340.233235:0:5810:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5810:1869752813241984:0@lo:104: 00010000:00010000:0.0:1783135340.233256:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135340.233710:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813242112:0@lo:103: 00000100:00100000:1.0:1783135340.233750:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135340.233849:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813242112 00000100:00100000:3.0:1783135340.233854:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813242112 00010000:00010000:3.0:1783135340.233876:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c759 expref: 15 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135340.233902:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783135340.233909:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:3313:x1869752813242112:12345-0@lo:103: 00010000:00010000:3.0:1783135340.233920:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135340.233925:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c759 expref: 15 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.233935:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c759 expref: 15 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.233962:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c760 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c759 expref: 15 pid: 5788 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.233987:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.233995:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783135340.234010:0:5782:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001887877s 00010000:00010000:3.0:1783135340.234014:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.234021:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.234028:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.234035:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.234041:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487800 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135340.234045:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.234052:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.234066:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135340.234084:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135340.234116:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c8b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:3313:x1869752813242112:12345-0@lo:103: Request processed in 207us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135340.234124:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135340.234241:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813242112:0@lo:103: 00010000:00010000:1.0:1783135340.234971:0:5810:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.235013:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135340.235020:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487800/0xf646e0cda875c80f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135340.242554:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:7476:x1869752813241856:12345-0@lo:253: Request processed in 33520us (33753us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135340.242568:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1783135340.242652:0:7476:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7476:1869752813241856:0@lo:253: 10000000:01000000:3.0:1783135340.242669:0:7476:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783135340.242672:0:7476:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135340.242674:0:7476:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135340.242675:0:7476:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135340.242677:0:7476:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135340.242678:0:7476:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135340.242679:0:7476:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135340.242681:0:7476:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135340.242682:0:7476:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783135340.242683:0:7476:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783135340.242685:0:7476:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135340.242687:0:7476:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783135340.242700:0:7476:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783135340.248452:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135340.248676:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135340.248902:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135340.249099:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135340.249426:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135340.249675:0:7476:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783135340.251019:0:7476:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1783135340.478686:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1783135340.520597:0:7476:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1783135340.520606:0:7476:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1783135340.520644:0:7476:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783135340.520710:0:7476:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783135340.520731:0:7476:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1783135340.520757:0:7476:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1783135341.517069:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135342.524654:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135343.547122:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135344.250739:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813242240:0@lo:13: 00000100:00100000:1.0:1783135344.250855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135344.250976:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813242240 00000100:00100000:2.0:1783135344.250985:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813242240 00000100:00100000:2.0:1783135344.251046:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135344.251057:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813242240:12345-0@lo:13: 00002000:00000024:2.0:1783135344.251102:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783135344.251366:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135344.251466:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813242240:12345-0@lo:13: Request processed in 410us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135344.251474:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783135344.251546:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05730000 x1869752813242240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135344.251570:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813242240:0@lo:13: 00010000:00010000:0.0:1783135344.570477:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135345.275054:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813242496:0@lo:400: 00000100:00100000:3.0:1783135345.275135:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135345.275204:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135345.275210:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813242368:0@lo:400: 00000100:00100000:3.0:1783135345.275262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135345.275287:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813242880:0@lo:400: 00000100:00100000:3.0:1783135345.275311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135345.275344:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813242496 00000100:00100000:3.0:1783135345.275351:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813242496 00000100:00100000:3.0:1783135345.275398:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813242880 00000100:00100000:3.0:1783135345.275402:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813242880 00000100:00100000:3.0:1783135345.275429:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135345.275437:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813242496:12345-0@lo:400: 00000100:00100000:3.0:1783135345.275489:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813242496:12345-0@lo:400: Request processed in 52us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135345.275497:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135345.275517:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135345.275524:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813242880:12345-0@lo:400: 00000100:00100000:3.0:1783135345.275551:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813242880:12345-0@lo:400: Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135345.275557:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1783135345.275594:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05733100 x1869752813242880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135345.275609:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813242880:0@lo:400: 00010000:00080000:3.0:1783135345.275622:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05731500 x1869752813242496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135345.275630:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813242496:0@lo:400: 00000100:00100000:3.0:1783135345.275677:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813242368 00000100:00100000:3.0:1783135345.275681:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813242368 00000100:00100000:3.0:1783135345.275709:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135345.275723:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:3312:x1869752813242368:12345-0@lo:400: 00000100:00100000:3.0:1783135345.275762:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:3312:x1869752813242368:12345-0@lo:400: Request processed in 40us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135345.275769:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135345.275839:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813242368:0@lo:400: 00000100:00080000:0.0:1783135345.276131:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135345.277032:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813242624:0@lo:400: 00000100:00100000:1.0:1783135345.277086:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135345.277119:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135345.277126:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813242752:0@lo:400: 00000100:00100000:1.0:1783135345.277152:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135345.277200:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813242752 00000100:00100000:1.0:1783135345.277207:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813242752 00000100:00100000:1.0:1783135345.277251:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135345.277261:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813242752:12345-0@lo:400: 00000100:00100000:1.0:1783135345.277314:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813242752:12345-0@lo:400: Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135345.277321:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783135345.277381:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05732300 x1869752813242752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135345.277395:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813242752:0@lo:400: 00000100:00100000:1.0:1783135345.277422:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813242624 00000100:00100000:1.0:1783135345.277425:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813242624 00000100:00100000:1.0:1783135345.277461:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135345.277468:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813242624:12345-0@lo:400: 00000100:00100000:1.0:1783135345.277505:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813242624:12345-0@lo:400: Request processed in 37us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135345.277512:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1783135345.277527:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1783135345.277548:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05732680 x1869752813242624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135361 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135345.277557:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813242624:0@lo:400: 00010000:00010000:0.0:1783135345.596808:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135346.618304:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783135346.809897:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135346.809908:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f04f38800 from 30 10000000:01000000:1.0:1783135346.809914:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135346.809966:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.809978:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.809988:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135346.810012:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243008:0@lo:101: 00000100:00100000:1.0:1783135346.810094:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135346.810336:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f39655540 going to sleep for 11 seconds 00000100:00100000:0.0:1783135346.810436:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813243008 00000100:00100000:0.0:1783135346.810445:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813243008 00000100:00100000:0.0:1783135346.810498:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135346.810507:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813243008:12345-0@lo:101: 00010000:00010000:0.0:1783135346.810523:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135346.810537:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c816 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.810562:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c816 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.810571:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c816 expref: 14 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.810580:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05220a00, rc 0) 00000100:00100000:0.0:1783135346.810619:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813243008:12345-0@lo:101: Request processed in 113us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135346.810625:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135346.810672:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243008:0@lo:101: 00010000:00010000:0.0:1783135346.810685:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.810693:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135346.810742:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243136:0@lo:501: 00000100:00100000:0.0:1783135346.810778:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.810793:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3d83b000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135346.810805:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813243136 00000100:00100000:0.0:1783135346.810809:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813243136 00000100:00100000:0.0:1783135346.810847:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783135346.810854:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813243136:12345-0@lo:501: 00000100:00100000:0.0:1783135346.811609:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813243136:12345-0@lo:501: Request processed in 751us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135346.811617:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783135346.811680:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243136:0@lo:501: 00000100:00100000:1.0:1783135346.811713:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243264:0@lo:503: 00000100:00100000:1.0:1783135346.811754:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135346.811783:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f396553c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135346.811839:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813243264 00000100:00100000:0.0:1783135346.811846:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813243264 00000100:00100000:0.0:1783135346.811950:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783135346.811957:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813243264:12345-0@lo:503: 00000100:00100000:0.0:1783135346.812291:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813243264:12345-0@lo:503: Request processed in 334us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135346.812299:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783135346.812429:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243264:0@lo:503: 00000100:00100000:0.0:1783135346.812762:0:7795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be37100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7795:1869752813243392:0@lo:502: 00000100:00100000:0.0:1783135346.812804:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.812931:0:7795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3d83b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.813012:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813243392 00000100:00100000:1.0:1783135346.813017:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813243392 00000100:00100000:1.0:1783135346.813051:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783135346.813058:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7795:x1869752813243392:12345-0@lo:502: 00000100:00100000:1.0:1783135346.813391:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7795:x1869752813243392:12345-0@lo:502: Request processed in 332us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.813398:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1783135346.813476:0:7795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be37100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7795:1869752813243392:0@lo:502: 00000100:00100000:0.0:1783135346.813532:0:7795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be37100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7795:1869752813243520:0@lo:502: 00000100:00100000:0.0:1783135346.813568:0:7795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.813595:0:7795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3d83b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.813643:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813243520 00000100:00100000:1.0:1783135346.813648:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813243520 00000100:00100000:1.0:1783135346.813676:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783135346.813682:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7795:x1869752813243520:12345-0@lo:502: 00000100:00100000:1.0:1783135346.813994:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:7795:x1869752813243520:12345-0@lo:502: Request processed in 311us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.814001:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1783135346.816719:0:7795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be37100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7795:1869752813243520:0@lo:502: 00000040:00080000:1.0:1783135346.816841:0:7795:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783135346.817070:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783135346.817088:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135346.817097:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.817107:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135346.817118:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783135346.817121:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1783135346.817123:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135346.817209:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.817218:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.817227:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135346.817245:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243648:0@lo:101: 00000100:00100000:2.0:1783135346.817301:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135346.817339:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.817386:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813243648 00000100:00100000:1.0:1783135346.817393:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813243648 00000100:00100000:1.0:1783135346.817441:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783135346.817450:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813243648:12345-0@lo:101: 00010000:00010000:1.0:1783135346.817461:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135346.817472:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c824 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.817507:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c824 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.817518:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c824 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.817527:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42156a00, rc 0) 00000100:00100000:1.0:1783135346.817566:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813243648:12345-0@lo:101: Request processed in 116us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.817573:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783135346.817610:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243648:0@lo:101: 00010000:00010000:1.0:1783135346.817621:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.817630:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135346.817670:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243776:0@lo:501: 00000100:00100000:1.0:1783135346.817694:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135346.817708:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f39655240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.817719:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813243776 00000100:00100000:1.0:1783135346.817722:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813243776 00000100:00100000:1.0:1783135346.817742:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783135346.817749:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813243776:12345-0@lo:501: 00000100:00100000:1.0:1783135346.818217:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813243776:12345-0@lo:501: Request processed in 468us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.818224:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1783135346.818392:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243776:0@lo:501: 00000100:00100000:2.0:1783135346.818421:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243904:0@lo:503: 00000100:00100000:2.0:1783135346.818458:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135346.818523:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135346.820468:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813243904 00000100:00100000:0.0:1783135346.820479:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813243904 00000100:00100000:0.0:1783135346.820539:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783135346.820549:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813243904:12345-0@lo:503: 00000100:00100000:0.0:1783135346.820959:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813243904:12345-0@lo:503: Request processed in 410us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135346.820968:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1783135346.821032:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813243904:0@lo:503: 00000100:00100000:0.0:1783135346.821410:0:7796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7796:1869752813244032:0@lo:502: 00000100:00100000:0.0:1783135346.821456:0:7796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.821482:0:7796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0569a780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.821558:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813244032 00000100:00100000:1.0:1783135346.821564:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813244032 00000100:00100000:1.0:1783135346.821598:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783135346.821607:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:7796:x1869752813244032:12345-0@lo:502: 00000100:00100000:1.0:1783135346.821779:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:7796:x1869752813244032:12345-0@lo:502: Request processed in 172us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.821786:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1783135346.821982:0:7796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7796:1869752813244032:0@lo:502: 00000020:01000000:0.0:1783135346.822004:0:7796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135346.822013:0:7796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135346.822016:0:7796:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783135346.822022:0:7796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783135346.822024:0:7796:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1783135346.822039:0:7796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7796:1869752813244160:0@lo:502: 00000100:00100000:0.0:1783135346.822073:0:7796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.822090:0:7796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0570e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.822146:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813244160 00000100:00100000:1.0:1783135346.822150:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813244160 00000100:00100000:1.0:1783135346.822283:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783135346.822291:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:7796:x1869752813244160:12345-0@lo:502: 00000100:00100000:1.0:1783135346.822414:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:7796:x1869752813244160:12345-0@lo:502: Request processed in 124us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.822422:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1783135346.830080:0:7796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7796:1869752813244160:0@lo:502: 00000020:01000000:0.0:1783135346.830141:0:7796:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135346.830153:0:7796:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135346.830155:0:7796:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783135346.830160:0:7796:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1783135346.834587:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1783135346.834631:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783135346.834642:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.834654:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135346.834663:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783135346.834666:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f063e9800 from 30 10000000:01000000:2.0:1783135346.834668:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135346.834708:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.834717:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.834728:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135346.834800:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813244288:0@lo:101: 00000100:00100000:2.0:1783135346.838728:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135346.839326:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135346.839397:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813244288 00000100:00100000:0.0:1783135346.839405:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813244288 00000100:00100000:0.0:1783135346.839604:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1783135346.839615:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813244288:12345-0@lo:101: 00010000:00010000:0.0:1783135346.839630:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135346.839647:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c832 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.839681:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c832 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.839693:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c832 expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.839702:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05220000, rc 0) 00000100:00100000:0.0:1783135346.839805:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813244288:12345-0@lo:101: Request processed in 192us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135346.839812:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783135346.844746:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813244288:0@lo:101: 00010000:00010000:2.0:1783135346.844775:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.844788:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135346.845638:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813244416:0@lo:501: 00000100:00100000:2.0:1783135346.845712:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135346.845758:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135346.845987:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813244416 00000100:00100000:0.0:1783135346.845993:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813244416 00000100:00100000:0.0:1783135346.847713:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783135346.847734:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813244416:12345-0@lo:501: 00000100:00100000:0.0:1783135346.848063:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813244416:12345-0@lo:501: Request processed in 337us (2349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135346.848071:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783135346.852073:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813244416:0@lo:501: 00000100:00100000:0.0:1783135346.852140:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813244544:0@lo:503: 00000100:00100000:0.0:1783135346.852215:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.852259:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0570e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.852358:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813244544 00000100:00100000:1.0:1783135346.852365:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813244544 00000100:00100000:1.0:1783135346.852416:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783135346.852424:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813244544:12345-0@lo:503: 00000100:00100000:1.0:1783135346.853986:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813244544:12345-0@lo:503: Request processed in 1556us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.853999:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783135346.860156:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813244544:0@lo:503: 00000100:00100000:1.0:1783135346.862084:0:7799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7799:1869752813244672:0@lo:502: 00000100:00100000:1.0:1783135346.862183:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135346.862234:0:7799:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f396553c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135346.862369:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813244672 00000100:00100000:2.0:1783135346.862376:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813244672 00000100:00100000:2.0:1783135346.862424:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783135346.862433:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:7799:x1869752813244672:12345-0@lo:502: 00000100:00100000:2.0:1783135346.862686:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:7799:x1869752813244672:12345-0@lo:502: Request processed in 252us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135346.862694:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783135346.862842:0:7799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7799:1869752813244672:0@lo:502: 00000100:00100000:1.0:1783135346.863019:0:7799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7799:1869752813244800:0@lo:502: 00000100:00100000:1.0:1783135346.863064:0:7799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135346.863087:0:7799:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f396553c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135346.863127:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813244800 00000100:00100000:0.0:1783135346.863131:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813244800 00000100:00100000:0.0:1783135346.863164:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1783135346.863172:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:7799:x1869752813244800:12345-0@lo:502: 00000100:00100000:0.0:1783135346.863316:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:7799:x1869752813244800:12345-0@lo:502: Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135346.863329:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783135346.863392:0:7799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7799:1869752813244800:0@lo:502: 00000040:00080000:1.0:1783135346.863411:0:7799:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1783135346.863552:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1783135346.863571:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135346.863580:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.863591:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135346.863600:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783135346.863603:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e8f063e9800 from 5 10000000:01000000:0.0:1783135346.863606:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135346.863631:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.863639:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.863648:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135346.863659:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813244928:0@lo:101: 00000100:00100000:0.0:1783135346.863685:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.863706:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08679a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135346.863762:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813244928 00000100:00100000:2.0:1783135346.863766:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813244928 00000100:00100000:2.0:1783135346.863796:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783135346.863803:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813244928:12345-0@lo:101: 00010000:00010000:2.0:1783135346.863811:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135346.863848:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c847 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c840 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.863940:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c840 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.863951:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c847 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c840 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.863960:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2e00, rc 0) 00000100:00100000:2.0:1783135346.863991:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813244928:12345-0@lo:101: Request processed in 188us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135346.863997:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783135346.864089:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813244928:0@lo:101: 00010000:00010000:0.0:1783135346.864100:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.864108:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135346.864152:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813245056:0@lo:256: 00000100:00100000:0.0:1783135346.864182:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.864199:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08679a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.864252:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813245056 00000100:00100000:1.0:1783135346.864256:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813245056 00000100:00100000:1.0:1783135346.864286:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783135346.864293:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813245056:12345-0@lo:256: 20000000:01000000:1.0:1783135346.864305:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135346.864321:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135346.864325:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1783135346.864395:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813245056:12345-0@lo:256: Request processed in 101us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.864402:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783135346.864505:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813245056:0@lo:256: 10000000:01000000:0.0:1783135346.864540:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135346.864545:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.864552:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135346.864558:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783135346.864560:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1783135346.864562:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783135346.864576:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.864584:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.864591:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135346.864602:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813245184:0@lo:101: 00000100:00100000:0.0:1783135346.864627:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.864680:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08679a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135346.868367:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813245184 00000100:00100000:1.0:1783135346.868383:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813245184 00000100:00100000:1.0:1783135346.868967:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783135346.868981:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813245184:12345-0@lo:101: 00010000:00010000:1.0:1783135346.868997:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135346.869015:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c84e expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.869044:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c84e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.869056:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c84e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135346.869064:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42156c00, rc 0) 00000100:00100000:1.0:1783135346.869149:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813245184:12345-0@lo:101: Request processed in 173us (4521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.869156:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783135346.869239:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813245184:0@lo:101: 00010000:00010000:0.0:1783135346.869263:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.869272:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135346.869334:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813245312:0@lo:501: 00000100:00100000:0.0:1783135346.869373:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.872221:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08679a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135346.875014:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813245312 00000100:00100000:2.0:1783135346.875029:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813245312 00000100:00100000:2.0:1783135346.875083:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783135346.875094:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813245312:12345-0@lo:501: 00000100:00100000:2.0:1783135346.875549:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813245312:12345-0@lo:501: Request processed in 456us (6179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135346.875557:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1783135346.877022:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813245312:0@lo:501: 00000100:00100000:0.0:1783135346.877079:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813245440:0@lo:503: 00000100:00100000:0.0:1783135346.877140:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.877175:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08679a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135346.877378:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813245440 00000100:00100000:2.0:1783135346.877385:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813245440 00000100:00100000:2.0:1783135346.877439:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783135346.877450:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813245440:12345-0@lo:503: 00000100:00100000:0.0:1783135346.878093:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813245440:0@lo:503: 00000100:00100000:2.0:1783135346.878991:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813245440:12345-0@lo:503: Request processed in 1537us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135346.879003:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783135346.888173:0:7802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7802:1869752813245568:0@lo:502: 00000100:00100000:0.0:1783135346.888252:0:7802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.888287:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813245568 00000100:00100000:0.0:1783135346.888294:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813245568 00000100:00100000:0.0:1783135346.888333:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135346.888341:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:7802:x1869752813245568:12345-0@lo:502: 00000100:00100000:0.0:1783135346.888634:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:7802:x1869752813245568:12345-0@lo:502: Request processed in 292us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135346.888642:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135346.888688:0:7802:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08679240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135346.888709:0:7802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7802:1869752813245568:0@lo:502: 00000020:01000000:0.0:1783135346.888742:0:7802:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135346.888750:0:7802:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1783135346.888756:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135346.888758:0:7802:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1783135346.888763:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1783135346.888766:0:7802:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.160@tcp to nid 0x20000c0a8c9a0 (192.168.201.160@tcp) 00000020:01000000:0.0:1783135346.888786:0:7802:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1783135346.888788:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783135346.888802:0:7802:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e8f37c4b380) 00000020:00000080:0.0:1783135346.888844:0:7802:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1783135346.888851:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1783135346.888924:0:7802:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1783135346.888930:0:7802:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1783135346.888936:0:7802:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875c863 00010000:00080000:0.0:1783135346.888964:0:7802:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8e03cf1800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.160@tcp at head 00010000:00010000:0.0:1783135346.889181:0:7802:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1783135346.889476:0:7802:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1783135346.889489:0:7802:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1783135346.890027:0:7802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135346.890240:0:7802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135346.890293:0:7802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1783135346.890359:0:7802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1783135346.891108:0:7804:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135346.891115:0:7804:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783135346.891639:0:7802:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135346.891651:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783135346.891685:0:7802:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783135346.891708:0:7802:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875c86a 00000100:00080000:3.0:1783135346.891718:0:7802:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135346.891724:0:7802:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8e03cf1800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:3.0:1783135346.891761:0:7802:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f05731180 x1869752813245696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135346.891790:0:7802:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783135346.891946:0:7802:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135346.891951:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135346.891953:0:7802:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783135346.891956:0:7802:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135346.891960:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135346.891961:0:7802:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783135346.891964:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783135346.891966:0:7802:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783135346.891994:0:7802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7802:1869752813245824:0@lo:502: 00000100:00100000:3.0:1783135346.892074:0:7802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135346.892106:0:7802:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09356e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135346.892176:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813245696:0@lo:8: 00000100:00100000:2.0:1783135346.892210:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135346.892250:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813245824 00000100:00100000:2.0:1783135346.892256:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813245824 00000100:00100000:2.0:1783135346.892288:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135346.892296:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:7802:x1869752813245824:12345-0@lo:502: 00000100:00100000:2.0:1783135346.892508:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:7802:x1869752813245824:12345-0@lo:502: Request processed in 212us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135346.892516:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783135346.892589:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813245696 00000100:00100000:3.0:1783135346.892593:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813245696 00000100:00100000:3.0:1783135346.892621:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135346.892626:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1869752813245696:12345-0@lo:8: 00010000:00080000:3.0:1783135346.892646:0:6587:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:3.0:1783135346.892668:0:6587:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875c871 00002000:00100000:3.0:1783135346.892682:0:6587:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e8f3c431800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1783135346.892686:0:6587:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1783135346.892690:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1783135346.892790:0:6587:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1783135346.892966:0:6587:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783135346.892988:0:6587:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c433800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135346.893023:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1869752813245696:12345-0@lo:8: Request processed in 396us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135346.893030:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135346.893064:0:7802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:7802:1869752813245824:0@lo:502: 00000020:01000000:3.0:1783135346.893091:0:7802:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135346.893097:0:7802:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135346.893099:0:7802:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783135346.893103:0:7802:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:2.0:1783135346.893404:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05731180 x1869752813245696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135346.893416:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783135346.893422:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1783135346.893437:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783135346.893442:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783135346.893445:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8e03cf1800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783135346.893456:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783135346.893462:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813245696:0@lo:8: 00000004:00080000:3.0:1783135346.894661:0:7804:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1783135346.894797:0:7804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 246323980669ns, next at 0ns, rc = 0 00000020:01000000:0.0:1783135346.896761:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1783135346.896791:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783135346.896801:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.896811:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135346.896840:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783135346.896848:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8f062a19c0 from 1 10000000:01000000:0.0:1783135346.896851:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783135346.896889:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.896898:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135346.896909:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135346.896931:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813246464:0@lo:101: 00000100:00100000:0.0:1783135346.896996:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135346.897029:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08679900 going to sleep for 11 seconds 00000100:00100000:2.0:1783135346.898945:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813246336:0@lo:400: 00000100:00100000:2.0:1783135346.899006:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135346.899043:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135346.899050:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813245952:0@lo:400: 00000100:00100000:2.0:1783135346.899071:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135346.899448:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813246336 00000100:00100000:2.0:1783135346.899456:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813246336 00000100:00100000:2.0:1783135346.899499:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813245952 00000100:00100000:2.0:1783135346.899502:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813245952 00000100:00100000:2.0:1783135346.899518:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135346.899526:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813246336:12345-0@lo:400: 00000100:00100000:2.0:1783135346.899580:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813246336:12345-0@lo:400: Request processed in 54us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135346.899587:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783135346.899604:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135346.899610:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813245952:12345-0@lo:400: 00000100:00100000:2.0:1783135346.899636:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813245952:12345-0@lo:400: Request processed in 27us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135346.899642:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1783135346.899769:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3be34000 x1869752813245952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135346.899787:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813245952:0@lo:400: 00010000:00080000:2.0:1783135346.899807:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3be36300 x1869752813246336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135346.899837:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813246336:0@lo:400: 00000100:00100000:2.0:1783135346.899879:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813246464 00000100:00100000:2.0:1783135346.899883:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813246464 00000100:00100000:2.0:1783135346.899908:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783135346.899914:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813246464:12345-0@lo:101: 00010000:00010000:2.0:1783135346.899924:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135346.899938:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c878 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.899963:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c878 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.899974:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c878 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.899983:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3200, rc 0) 00000100:00100000:2.0:1783135346.900015:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813246464:12345-0@lo:101: Request processed in 101us (3019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135346.900020:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1783135346.900055:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be37100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813246464:0@lo:101: 00010000:00010000:2.0:1783135346.900069:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.900078:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135346.900140:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813246592:0@lo:501: 00000100:00100000:2.0:1783135346.900179:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135346.900194:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135346.900206:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813246592 00000100:00100000:2.0:1783135346.900209:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813246592 00000100:00100000:2.0:1783135346.900228:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783135346.900233:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813246592:12345-0@lo:501: 00000100:00100000:2.0:1783135346.900422:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813246592:12345-0@lo:501: Request processed in 188us (255us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135346.900428:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783135346.900457:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813246592:0@lo:501: 10000000:01000000:2.0:1783135346.900478:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783135346.900486:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135346.900494:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135346.900931:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813246080:0@lo:400: 00000100:00100000:1.0:1783135346.900966:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135346.900993:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135346.900999:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813246208:0@lo:400: 00000100:00100000:1.0:1783135346.901023:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135346.901063:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813246080 00000100:00100000:1.0:1783135346.901068:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813246080 00000100:00100000:1.0:1783135346.901097:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135346.901104:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813246080:12345-0@lo:400: 00000100:00100000:1.0:1783135346.901141:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813246080:12345-0@lo:400: Request processed in 38us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135346.901147:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1783135346.901174:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3be36d80 x1869752813246080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135346.901185:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813246080:0@lo:400: 00000100:00100000:3.0:1783135346.901259:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813246208 00000100:00100000:3.0:1783135346.901262:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813246208 00000100:00100000:3.0:1783135346.901305:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135346.901312:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813246208:12345-0@lo:400: 00000100:00100000:3.0:1783135346.901347:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813246208:12345-0@lo:400: Request processed in 37us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135346.901364:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783135346.901399:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3be34380 x1869752813246208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135346.901408:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813246208:0@lo:400: 00000100:00080000:1.0:1783135346.901450:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783135347.009141:0:7805:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783135347.009188:0:7805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7805:1869752813246848:0@lo:7: 00000100:00100000:3.0:1783135347.009268:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135347.009315:0:7805:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09356780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135347.009360:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813246720:0@lo:13: 00000100:00100000:3.0:1783135347.009391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135347.009434:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813246720 00000100:00100000:3.0:1783135347.009443:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813246720 00000100:00100000:3.0:1783135347.009498:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135347.009510:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813246720:12345-0@lo:13: 00002000:00000024:3.0:1783135347.009542:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1783135347.009584:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813246720:12345-0@lo:13: Request processed in 76us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135347.009591:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1783135347.009632:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05731500 x1869752813246720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135347.009652:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813246720:0@lo:13: 00000100:00100000:2.0:1783135347.010006:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813246848 00000100:00100000:2.0:1783135347.010012:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813246848 00000100:00100000:2.0:1783135347.010200:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135347.010209:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1869752813246848:12345-0@lo:7: 00000100:00080000:1.0:1783135347.013127:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1783135347.026245:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1783135347.026255:0:6589:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783135347.026354:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1869752813246848:12345-0@lo:7: Request processed in 16141us (17083us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135347.026374:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783135347.026443:0:7805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05733100 x1869752813246848/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783135363 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135347.026457:0:7805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7805:1869752813246848:0@lo:7: 00000004:00080000:2.0:1783135347.026471:0:7805:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783135347.026510:0:7805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7805:1869752813246976:0@lo:5: 00000100:00100000:2.0:1783135347.026544:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135347.026582:0:7805:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0f000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135347.026598:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813246976 00000100:00100000:2.0:1783135347.026605:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813246976 00000100:00100000:2.0:1783135347.026642:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135347.026651:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7805:x1869752813246976:12345-0@lo:5: 00002000:00080000:2.0:1783135347.026678:0:6587:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1783135347.026682:0:6587:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1783135347.034135:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7805:x1869752813246976:12345-0@lo:5: Request processed in 7474us (7580us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1783135347.034149:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1783135347.034267:0:7805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3b9dea00 x1869752813246976/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135363 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135347.034285:0:7805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7805:1869752813246976:0@lo:5: 00000004:00080000:3.0:1783135347.034311:0:7805:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1783135347.034355:0:7805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7805:1869752813247104:0@lo:700: 00000100:00100000:3.0:1783135347.034393:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135347.034441:0:7805:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09356780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.034506:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813247104 00000100:00100000:1.0:1783135347.034514:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813247104 00000100:00100000:1.0:1783135347.034565:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135347.034574:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+8:7805:x1869752813247104:12345-0@lo:700: 00000100:00100000:1.0:1783135347.034614:0:6596:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6596:1869752813247232:0@lo:700: 00000100:00100000:1.0:1783135347.034658:0:6596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135347.034682:0:6596:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3d83b840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.034700:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813247232 00000100:00100000:1.0:1783135347.034703:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813247232 00000100:00100000:1.0:1783135347.034738:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135347.034743:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6596:x1869752813247232:12345-0@lo:700: 00000100:00080000:1.0:1783135347.035260:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1783135347.109472:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:3.0:1783135347.175580:0:7840:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 40000000:02000000:1.0:1783135347.187212:0:5801:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1783135347.208617:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6596:x1869752813247232:12345-0@lo:700: Request processed in 173858us (173942us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135347.208632:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783135347.208970:0:6596:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10b5df80 x1869752813247232/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783135363 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135347.208986:0:6596:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6596:1869752813247232:0@lo:700: 40000000:02000000:1.0:1783135347.208999:0:6596:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1783135347.344842:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1783135347.344871:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1783135347.349699:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7805:x1869752813247104:12345-0@lo:700: Request processed in 315117us (315296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135347.349714:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783135347.349876:0:7805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05731500 x1869752813247104/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783135363 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135347.349889:0:7805:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783135347.349909:0:7805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7805:1869752813247104:0@lo:700: 00000004:02000040:3.0:1783135347.407658:0:7805:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1783135347.419302:0:7805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7805:1869752813247360:0@lo:5: 00000100:00100000:3.0:1783135347.419372:0:7805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135347.419439:0:7805:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135347.419528:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813247360 00000100:00100000:1.0:1783135347.419536:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813247360 00000100:00100000:1.0:1783135347.419591:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135347.419600:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7805:x1869752813247360:12345-0@lo:5: 00002000:00080000:0.0:1783135347.433631:0:6589:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1783135347.433656:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1783135347.436962:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7805:x1869752813247360:12345-0@lo:5: Request processed in 17356us (17583us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783135347.436976:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783135347.437127:0:7805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05731500 x1869752813247360/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783135363 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135347.437159:0:7805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7805:1869752813247360:0@lo:5: 00000004:00080000:1.0:1783135347.437176:0:7805:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1783135347.642297:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135348.666388:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135349.370282:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135349.370312:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813247488:0@lo:13: 00000100:00100000:2.0:1783135349.370407:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135349.370849:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813247488 00000100:00100000:3.0:1783135349.370859:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813247488 00000100:00100000:3.0:1783135349.370931:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135349.370941:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813247488:12345-0@lo:13: 00002000:00000024:3.0:1783135349.370977:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135349.371043:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813247488:12345-0@lo:13: Request processed in 103us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135349.371050:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1783135349.371130:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783135349.371352:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05730000 x1869752813247488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135349.371371:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813247488:0@lo:13: 00010000:00010000:3.0:1783135349.690187:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135350.726532:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135351.738977:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135351.930612:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813247616:0@lo:400: 00000100:00100000:0.0:1783135351.930693:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135351.930803:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135351.930812:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813247744:0@lo:400: 00000100:00100000:2.0:1783135351.931051:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813247616 00000100:00100000:2.0:1783135351.931059:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813247616 00000100:00100000:2.0:1783135351.931112:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783135351.931122:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3314:x1869752813247616:12345-0@lo:400: 00000100:00100000:2.0:1783135351.931194:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3314:x1869752813247616:12345-0@lo:400: Request processed in 72us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135351.931201:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1783135351.931274:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813247616:0@lo:400: 00000100:00100000:0.0:1783135351.931662:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135351.931725:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813247872:0@lo:400: 00000100:00100000:0.0:1783135351.931751:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135351.931806:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813248000:0@lo:400: 00000100:00100000:2.0:1783135351.931984:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813247744 00000100:00100000:2.0:1783135351.931989:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813247744 00000100:00100000:2.0:1783135351.932017:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813247872 00000100:00100000:2.0:1783135351.932019:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813247872 00000100:00100000:2.0:1783135351.932043:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135351.932050:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813247744:12345-0@lo:400: 00000100:00100000:2.0:1783135351.932091:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813247744:12345-0@lo:400: Request processed in 42us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135351.932098:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135351.932111:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135351.932116:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813247872:12345-0@lo:400: 00000100:00100000:2.0:1783135351.932139:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813247872:12345-0@lo:400: Request processed in 24us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135351.932145:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1783135351.932167:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783135351.932188:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3be36300 x1869752813247872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135351.932200:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813247872:0@lo:400: 00010000:00080000:2.0:1783135351.932209:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3be36d80 x1869752813247744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135351.932218:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813247744:0@lo:400: 00000100:00100000:0.0:1783135351.932391:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135351.932441:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135351.932448:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813248128:0@lo:400: 00000100:00100000:0.0:1783135351.932472:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135351.932548:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135351.932555:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813248256:0@lo:400: 00000100:00100000:2.0:1783135351.932584:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135351.932690:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813248000 00000100:00100000:2.0:1783135351.932694:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813248000 00000100:00100000:2.0:1783135351.932724:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813248256 00000100:00100000:2.0:1783135351.932727:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813248256 00000100:00100000:2.0:1783135351.932741:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135351.932747:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813248000:12345-0@lo:400: 00000100:00100000:2.0:1783135351.932796:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813248000:12345-0@lo:400: Request processed in 48us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135351.932802:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135351.932844:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135351.932851:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813248256:12345-0@lo:400: 00000100:00100000:2.0:1783135351.934143:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813248256:12345-0@lo:400: Request processed in 1285us (1550us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135351.934155:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135351.934190:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813248128 00000100:00100000:2.0:1783135351.934195:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813248128 00000100:00100000:2.0:1783135351.935416:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135351.935434:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813248128:12345-0@lo:400: 00000100:00100000:2.0:1783135351.935504:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813248128:12345-0@lo:400: Request processed in 78us (3031us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135351.935512:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1783135351.935551:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135351.935557:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135351.935560:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783135351.935723:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bfa300 x1869752813248256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135351.935738:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813248256:0@lo:400: 00010000:00080000:2.0:1783135351.936414:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bfa680 x1869752813248128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135351.936437:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813248128:0@lo:400: 00010000:00080000:2.0:1783135351.936455:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3be34380 x1869752813248000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135351.936464:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813248000:0@lo:400: 00000100:00100000:1.0:1783135352.445917:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135352.445946:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813248384:0@lo:13: 00000100:00100000:1.0:1783135352.446037:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135352.447301:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813248384 00000100:00100000:3.0:1783135352.447313:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813248384 00000100:00100000:3.0:1783135352.447375:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135352.447387:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813248384:12345-0@lo:13: 00002000:00000024:3.0:1783135352.447442:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135352.447627:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813248384:12345-0@lo:13: Request processed in 242us (1591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135352.447636:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1783135352.447677:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10b5df80 x1869752813248384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135352.447696:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813248384:0@lo:13: 00000001:00080000:2.0:1783135352.544924:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1783135352.763037:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135353.128002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135353.129167:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792252544 00000100:00100000:2.0:1783135353.129179:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792252544 00000100:00100000:2.0:1783135353.129231:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 112 00000100:00100000:2.0:1783135353.129241:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2359:x1869752792252544:12345-192.168.201.60@tcp:250: 00010000:00080000:2.0:1783135353.129272:0:5788:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4ebba92a-2ae4-47ab-a127-5cfd3761e278@192.168.201.60@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:2.0:1783135353.129655:0:5788:0:(genops.c:1406:class_connect()) connect: client 4ebba92a-2ae4-47ab-a127-5cfd3761e278, cookie 0xf646e0cda875c886 00000100:00080000:2.0:1783135353.129844:0:5788:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c6f5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135353.129929:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+5:2359:x1869752792252544:12345-192.168.201.60@tcp:250: Request processed in 687us (1936us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135353.129938:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 112 00000100:00100000:3.0:1783135353.141189:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135353.141225:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792252672 00000100:00100000:3.0:1783135353.141235:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792252672 00000100:00100000:3.0:1783135353.141285:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 113 00000100:00100000:3.0:1783135353.141306:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+5:5564:x1869752792252672:12345-192.168.201.60@tcp:101: 00010000:00010000:3.0:1783135353.141323:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135353.141340:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11cbf expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135353.141377:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135353.141389:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135353.141399:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487200, rc 0) 00000100:00100000:3.0:1783135353.141606:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+6:5564:x1869752792252672:12345-192.168.201.60@tcp:101: Request processed in 311us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135353.141614:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 113 00000100:00100000:0.0:1783135353.146725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135353.146805:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792252800 00000100:00100000:2.0:1783135353.146830:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792252800 00000100:00100000:2.0:1783135353.146882:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 114 00000100:00100000:2.0:1783135353.146890:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+6:5564:x1869752792252800:12345-192.168.201.60@tcp:501: 00000100:00100000:2.0:1783135353.147153:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+6:5564:x1869752792252800:12345-192.168.201.60@tcp:501: Request processed in 262us (437us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783135353.147161:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 114 00000100:00100000:2.0:1783135353.148698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135353.148777:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792252928 00000100:00100000:0.0:1783135353.148784:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792252928 00000100:00100000:0.0:1783135353.148854:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 115 00000100:00100000:0.0:1783135353.148863:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+6:5564:x1869752792252928:12345-192.168.201.60@tcp:101: 00010000:00010000:0.0:1783135353.148880:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135353.148899:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11cc6 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135353.148927:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135353.148950:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135353.148959:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05221400, rc 0) 00000100:00100000:0.0:1783135353.149012:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+7:5564:x1869752792252928:12345-192.168.201.60@tcp:101: Request processed in 150us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135353.149019:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 115 00000100:00100000:0.0:1783135353.150187:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135353.150254:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792253056 00000100:00100000:3.0:1783135353.150261:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792253056 00000100:00100000:3.0:1783135353.150309:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 116 00000100:00100000:3.0:1783135353.150319:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+7:5564:x1869752792253056:12345-192.168.201.60@tcp:501: 00000100:00100000:3.0:1783135353.150623:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5564:x1869752792253056:12345-192.168.201.60@tcp:501: Request processed in 306us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135353.150631:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 116 00000100:00100000:0.0:1783135353.158086:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135353.158305:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792253184 00000100:00100000:2.0:1783135353.158333:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792253184 00000100:00100000:2.0:1783135353.158394:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 117 00000100:00100000:2.0:1783135353.158404:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5564:x1869752792253184:12345-192.168.201.60@tcp:503: 00000100:00100000:2.0:1783135353.158643:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5564:x1869752792253184:12345-192.168.201.60@tcp:503: Request processed in 240us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135353.158650:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 117 00000100:00100000:2.0:1783135353.167210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135353.167509:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792253312 00000100:00100000:1.0:1783135353.167520:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792253312 00000100:00100000:1.0:1783135353.167608:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 118 00000100:00100000:1.0:1783135353.167618:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5582:x1869752792253312:12345-192.168.201.60@tcp:502: 00000100:00100000:1.0:1783135353.167968:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5582:x1869752792253312:12345-192.168.201.60@tcp:502: Request processed in 349us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135353.167976:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 118 00000100:00100000:0.0:1783135353.194688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135353.194872:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792253440 00000100:00100000:3.0:1783135353.194885:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792253440 00000100:00100000:3.0:1783135353.194983:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 119 00000100:00100000:3.0:1783135353.194994:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5582:x1869752792253440:12345-192.168.201.60@tcp:502: 00000100:00100000:3.0:1783135353.195734:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5582:x1869752792253440:12345-192.168.201.60@tcp:502: Request processed in 737us (1049us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135353.195744:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 119 00000100:00100000:1.0:1783135353.209895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135353.209969:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792253568 00000100:00100000:0.0:1783135353.209978:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792253568 00000100:00100000:0.0:1783135353.210028:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 120 00000100:00100000:0.0:1783135353.210037:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5564:x1869752792253568:12345-192.168.201.60@tcp:101: 00010000:00010000:0.0:1783135353.210060:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135353.210076:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05221800/0xf646e0cda875c89b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11cf0 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135353.210102:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05221800/0xf646e0cda875c89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf0 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135353.210114:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05221800/0xf646e0cda875c89b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf0 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135353.210124:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05221800, rc 0) 00000100:00100000:0.0:1783135353.210183:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5564:x1869752792253568:12345-192.168.201.60@tcp:101: Request processed in 148us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135353.210205:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 120 00000100:00100000:0.0:1783135353.216028:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135353.216180:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792253696 00000100:00100000:3.0:1783135353.216190:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792253696 00000100:00100000:3.0:1783135353.216624:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 121 00000100:00100000:3.0:1783135353.216637:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5564:x1869752792253696:12345-192.168.201.60@tcp:256: 20000000:01000000:3.0:1783135353.216663:0:5789:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783135353.216684:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783135353.216688:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783135353.216691:0:5789:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783135353.216693:0:5789:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1783135353.222807:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5564:x1869752792253696:12345-192.168.201.60@tcp:256: Request processed in 6163us (6778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135353.222857:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 121 00000100:00100000:1.0:1783135353.230078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135353.230183:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792253824 00000100:00100000:0.0:1783135353.230196:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792253824 00000100:00100000:1.0:1783135353.230463:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 122 00000100:00100000:1.0:1783135353.230475:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5564:x1869752792253824:12345-192.168.201.60@tcp:101: 00010000:00010000:1.0:1783135353.230493:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135353.230511:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11cf7 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135353.230540:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135353.230551:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 10 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135353.230562:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42156000, rc 0) 00000100:00100000:1.0:1783135353.230634:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5564:x1869752792253824:12345-192.168.201.60@tcp:101: Request processed in 161us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135353.230642:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 122 00000100:00100000:0.0:1783135353.236728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135353.236862:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792253952 00000100:00100000:0.0:1783135353.236871:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792253952 00000100:00100000:0.0:1783135353.236915:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 123 00000100:00100000:0.0:1783135353.236923:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5564:x1869752792253952:12345-192.168.201.60@tcp:501: 00000100:00100000:0.0:1783135353.238143:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5564:x1869752792253952:12345-192.168.201.60@tcp:501: Request processed in 1214us (1417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135353.238164:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 123 00000100:00100000:2.0:1783135353.243674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135353.243802:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792254080 00000100:00100000:0.0:1783135353.243812:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792254080 00000100:00100000:0.0:1783135353.243890:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 124 00000100:00100000:0.0:1783135353.243900:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5564:x1869752792254080:12345-192.168.201.60@tcp:503: 00000100:00100000:0.0:1783135353.244415:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5564:x1869752792254080:12345-192.168.201.60@tcp:503: Request processed in 514us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135353.244425:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 124 00000100:00100000:2.0:1783135353.257110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135353.257600:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792254208 00000100:00100000:3.0:1783135353.257609:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792254208 00000100:00100000:3.0:1783135353.257660:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 125 00000100:00100000:3.0:1783135353.257671:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5587:x1869752792254208:12345-192.168.201.60@tcp:502: 00000100:00100000:3.0:1783135353.262739:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5587:x1869752792254208:12345-192.168.201.60@tcp:502: Request processed in 5059us (5628us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135353.262764:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 125 00000100:00100000:3.0:1783135353.265971:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135353.266048:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792254336 00000100:00100000:2.0:1783135353.266067:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792254336 00000100:00100000:2.0:1783135353.266126:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 126 00000100:00100000:2.0:1783135353.266137:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5587:x1869752792254336:12345-192.168.201.60@tcp:502: 00000100:00100000:2.0:1783135353.266431:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5587:x1869752792254336:12345-192.168.201.60@tcp:502: Request processed in 294us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135353.266439:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 126 00000100:00100000:2.0:1783135353.272384:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135353.272999:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792254464 00000100:00100000:3.0:1783135353.273018:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792254464 00000100:00100000:3.0:1783135353.273142:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:3.0:1783135353.273154:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1869752792254464:12345-192.168.201.60@tcp:38: 00010000:00080000:3.0:1783135353.273195:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:3.0:1783135353.273262:0:5794:0:(genops.c:1406:class_connect()) connect: client 0c7819a6-778a-4617-af33-00460db74182, cookie 0xf646e0cda875c8a9 00000004:00100000:3.0:1783135353.273302:0:5794:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1783135353.273309:0:5794:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:0.0:1783135353.338153:0:5794:0:(import.c:65:import_set_state_nolock()) ffff8e8e03cf4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135353.338280:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:2359:x1869752792254464:12345-192.168.201.60@tcp:38: Request processed in 65124us (65905us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135353.338297:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4 00010000:00010000:0.0:1783135353.786521:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135354.360639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135354.360769:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135354.360852:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792254592 00000100:00100000:2.0:1783135354.360866:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792254592 00000100:00100000:3.0:1783135354.360881:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792254720 00000100:00100000:3.0:1783135354.360889:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792254720 00000100:00100000:2.0:1783135354.360957:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:2.0:1783135354.360971:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+7:0:x1869752792254592:12345-192.168.201.60@tcp:41: 00000100:00080000:0.0:1783135354.361022:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:2.0:1783135354.361134:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135354.361375:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+7:0:x1869752792254592:12345-192.168.201.60@tcp:41: Request processed in 395us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135354.361406:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:2.0:1783135354.361456:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:2.0:1783135354.361469:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:5564:x1869752792254720:12345-192.168.201.60@tcp:41: 00000004:00000024:2.0:1783135354.361502:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135354.361537:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:5564:x1869752792254720:12345-192.168.201.60@tcp:41: Request processed in 72us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135354.361542:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:0.0:1783135354.368108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135354.369211:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792254848 00000100:00100000:3.0:1783135354.369232:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792254848 00000100:00100000:3.0:1783135354.369322:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:3.0:1783135354.369337:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:5564:x1869752792254848:12345-192.168.201.60@tcp:40: 00000100:00100000:3.0:1783135354.369476:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:5564:x1869752792254848:12345-192.168.201.60@tcp:40: Request processed in 141us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135354.369484:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:3.0:1783135354.377762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135354.377849:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135354.377901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135354.378050:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792254976 00000100:00100000:1.0:1783135354.378064:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792254976 00000100:00100000:1.0:1783135354.378111:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792255104 00000100:00100000:1.0:1783135354.378113:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792255104 00000100:00100000:1.0:1783135354.378132:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:1.0:1783135354.378142:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1869752792254976:12345-192.168.201.60@tcp:8: 00010000:00080000:1.0:1783135354.378181:0:6589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:1.0:1783135354.378219:0:6589:0:(genops.c:1406:class_connect()) connect: client 0c7819a6-778a-4617-af33-00460db74182, cookie 0xf646e0cda875c8b0 00002000:00100000:1.0:1783135354.378233:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c7819a6-778a-4617-af33-00460db74182/ffff8e8f3bf6d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135354.378262:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783135354.378648:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135354.378688:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf6f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135354.378797:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2359:x1869752792254976:12345-192.168.201.60@tcp:8: Request processed in 654us (980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135354.378807:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:1.0:1783135354.378871:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:1.0:1783135354.378877:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1869752792255104:12345-192.168.201.60@tcp:8: 00010000:00080000:1.0:1783135354.378897:0:6589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp t0 exp 0000000000000000 cur 253 last 0 00000020:00000080:1.0:1783135354.378925:0:6589:0:(genops.c:1406:class_connect()) connect: client 0c7819a6-778a-4617-af33-00460db74182, cookie 0xf646e0cda875c8b7 00002000:00100000:1.0:1783135354.378931:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0c7819a6-778a-4617-af33-00460db74182/ffff8e8f3bf6e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135354.378953:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783135354.379008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135354.379131:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792255360 00000100:00100000:3.0:1783135354.379154:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792255360 00000100:00100000:3.0:1783135354.379201:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 127 00000100:00100000:3.0:1783135354.379210:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2363:x1869752792255360:12345-192.168.201.60@tcp:400: 00000100:00100000:3.0:1783135354.379258:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2363:x1869752792255360:12345-192.168.201.60@tcp:400: Request processed in 50us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135354.379266:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 127 00002000:00080000:1.0:1783135354.379287:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783135354.379311:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf69800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135354.379349:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2359:x1869752792255104:12345-192.168.201.60@tcp:8: Request processed in 470us (1446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135354.379362:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:2.0:1783135354.384093:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792255232 00000100:00100000:2.0:1783135354.384114:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792255232 00000100:00100000:2.0:1783135354.384218:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:2.0:1783135354.384231:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+6:5564:x1869752792255232:12345-192.168.201.60@tcp:33: 00000004:00080000:2.0:1783135354.416863:0:5797:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 32528us 00000004:00200000:0.0:1783135354.454035:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783135354.455513:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+6:5564:x1869752792255232:12345-192.168.201.60@tcp:33: Request processed in 71270us (77748us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135354.455536:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:2.0:1783135354.490338:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813248512:0@lo:13: 00000100:00100000:2.0:1783135354.490460:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135354.490702:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813248512 00000100:00100000:3.0:1783135354.490714:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813248512 00000100:00100000:3.0:1783135354.490813:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135354.490863:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813248512:12345-0@lo:13: 00002000:00000024:3.0:1783135354.490904:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135354.490965:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813248512:12345-0@lo:13: Request processed in 106us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135354.490973:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1783135354.491073:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c39fb80 x1869752813248512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135354.491097:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813248512:0@lo:13: 00000100:00080000:0.0:1783135354.491255:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135354.664301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135354.664417:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792255488 00000100:00100000:2.0:1783135354.664431:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792255488 00000100:00100000:2.0:1783135354.664510:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:2.0:1783135354.664522:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:5604:x1869752792255488:12345-192.168.201.60@tcp:101: 00010000:00010000:2.0:1783135354.664551:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135354.667499:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2600/0xf646e0cda875c8be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135354.667775:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875c8c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135354.667790:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135354.667806:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135354.668074:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783135354.668079:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135354.668160:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135354.668191:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2600/0xf646e0cda875c8be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d21 expref: 8 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135354.668209:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875c8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d21 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135354.668230:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135354.668233:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135354.668237:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3800, rc 0) 00000100:00100000:2.0:1783135354.668319:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+7:5604:x1869752792255488:12345-192.168.201.60@tcp:101: Request processed in 3799us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135354.668328:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00010000:00010000:0.0:1783135354.810186:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783135355.699992:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00010000:00010000:3.0:1783135355.834180:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135356.858368:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135356.923786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135356.924028:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792255616 00000100:00100000:1.0:1783135356.924041:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792255616 00000100:00100000:1.0:1783135356.924131:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:1.0:1783135356.924146:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+7:5656:x1869752792255616:12345-192.168.201.60@tcp:41: 00000004:00000024:1.0:1783135356.924216:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783135356.924333:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+7:5656:x1869752792255616:12345-192.168.201.60@tcp:41: Request processed in 189us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135356.924342:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00080000:0.0:1783135356.924600:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135356.931401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135356.931507:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792255744 00000100:00100000:3.0:1783135356.931519:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792255744 00000100:00100000:3.0:1783135356.931621:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:3.0:1783135356.931633:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c7819a6-778a-4617-af33-00460db74182+5:5656:x1869752792255744:12345-192.168.201.60@tcp:13: 00002000:00000024:3.0:1783135356.931710:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135356.931871:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c7819a6-778a-4617-af33-00460db74182+5:5656:x1869752792255744:12345-192.168.201.60@tcp:13: Request processed in 239us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.931880:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00080000:0.0:1783135356.933164:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135356.935613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135356.936158:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792255872 00000100:00100000:3.0:1783135356.936172:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792255872 00000100:00100000:3.0:1783135356.936316:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:3.0:1783135356.936328:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c7819a6-778a-4617-af33-00460db74182+6:5656:x1869752792255872:12345-192.168.201.60@tcp:13: 00002000:00000024:3.0:1783135356.936408:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135356.936504:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0c7819a6-778a-4617-af33-00460db74182+6:5656:x1869752792255872:12345-192.168.201.60@tcp:13: Request processed in 178us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135356.936513:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00080000:0.0:1783135356.937194:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135357.050311:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813248896:0@lo:400: 00000100:00100000:3.0:1783135357.050458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135357.050567:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1783135357.050574:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813248768:0@lo:400: 00000100:00100000:3.0:1783135357.050598:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135357.050619:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813249280:0@lo:400: 00000100:00100000:3.0:1783135357.050649:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135357.050733:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813248896 00000100:00100000:3.0:1783135357.050744:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813248896 00000100:00100000:3.0:1783135357.050811:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813248768 00000100:00100000:3.0:1783135357.050846:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813248768 00000100:00100000:3.0:1783135357.050869:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135357.050881:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813248896:12345-0@lo:400: 00000100:00100000:3.0:1783135357.050948:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813248896:12345-0@lo:400: Request processed in 69us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135357.050955:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135357.050978:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135357.050983:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813248768:12345-0@lo:400: 00000100:00100000:3.0:1783135357.051007:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813248768:12345-0@lo:400: Request processed in 24us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135357.051012:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783135357.051032:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813249280 00000100:00100000:3.0:1783135357.051055:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813249280 00000100:00100000:3.0:1783135357.051092:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135357.051098:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813249280:12345-0@lo:400: 00000100:00100000:3.0:1783135357.051135:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813249280:12345-0@lo:400: Request processed in 37us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135357.051142:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135357.051216:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813248768:0@lo:400: 00010000:00080000:3.0:1783135357.051235:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c39df80 x1869752813249280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135357.051248:0:3312:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1783135357.051271:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813249280:0@lo:400: 00000100:00100000:3.0:1783135357.051287:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813248896:0@lo:400: 00000100:00100000:0.0:1783135357.051408:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813248640:0@lo:400: 00000100:00100000:0.0:1783135357.051459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135357.051514:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1869752813249152:0@lo:400: 00000100:00100000:0.0:1783135357.051537:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135357.051559:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135357.051566:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813249024:0@lo:400: 00000100:00100000:0.0:1783135357.051591:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135357.051624:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813249024 00000100:00100000:0.0:1783135357.051627:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813249024 00000100:00100000:0.0:1783135357.051664:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135357.051673:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813249024:12345-0@lo:400: 00000100:00100000:0.0:1783135357.051728:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813249024:12345-0@lo:400: Request processed in 57us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135357.051735:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1783135357.051767:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135357.051785:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135357.051788:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783135357.051811:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c39ca80 x1869752813249024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135357.051847:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813249024:0@lo:400: 00000100:00100000:0.0:1783135357.051866:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813249152 00000100:00100000:0.0:1783135357.051869:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813249152 00000100:00100000:0.0:1783135357.051903:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783135357.051909:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869752813249152:12345-0@lo:400: 00000100:00100000:0.0:1783135357.051951:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869752813249152:12345-0@lo:400: Request processed in 42us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135357.051958:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1783135357.051971:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135357.051988:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1869752813249152:0@lo:400: 00000100:00100000:3.0:1783135357.054420:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813248640 00000100:00100000:3.0:1783135357.054443:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813248640 00000100:00100000:3.0:1783135357.054575:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783135357.054593:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3314:x1869752813248640:12345-0@lo:400: 00000100:00100000:3.0:1783135357.057498:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3314:x1869752813248640:12345-0@lo:400: Request processed in 2895us (6022us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135357.057517:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783135357.062084:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813248640:0@lo:400: 00000100:00100000:3.0:1783135357.565037:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813249408:0@lo:13: 00000100:00100000:3.0:1783135357.565141:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135357.565281:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813249408 00000100:00100000:2.0:1783135357.565304:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813249408 00000100:00100000:2.0:1783135357.565373:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135357.565383:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813249408:12345-0@lo:13: 00002000:00000024:2.0:1783135357.565413:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135357.570791:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813249408:12345-0@lo:13: Request processed in 5392us (5634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135357.570810:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783135357.571749:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bfaa00 x1869752813249408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135357.571797:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813249408:0@lo:13: 00010000:00010000:0.0:1783135357.889506:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783135358.683159:0:5817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00010000:00010000:3.0:1783135358.909993:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783135359.155970:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000100:00100000:3.0:1783135359.482946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135359.483006:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135359.483037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135359.483121:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135359.483163:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792256128 00000100:00100000:3.0:1783135359.483176:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792256128 00000100:00100000:3.0:1783135359.483263:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:3.0:1783135359.483359:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792256128:12345-192.168.201.60@tcp:400: 00000100:00100000:3.0:1783135359.483464:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792256128:12345-192.168.201.60@tcp:400: Request processed in 110us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135359.483472:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:3.0:1783135359.483505:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792256256 00000100:00100000:3.0:1783135359.483509:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792256256 00000100:00100000:3.0:1783135359.483537:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792256384 00000100:00100000:3.0:1783135359.483539:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792256384 00000100:00100000:3.0:1783135359.483557:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:3.0:1783135359.483563:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792256256:12345-192.168.201.60@tcp:400: 00000100:00100000:3.0:1783135359.483592:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792256256:12345-192.168.201.60@tcp:400: Request processed in 30us (555us total) trans 0 rc 0/0 00000100:00080000:2.0:1783135359.483667:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135359.483675:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135359.483678:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00080000:2.0:1783135359.483679:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135359.483694:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:1.0:1783135359.483757:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792256000 00000100:00100000:1.0:1783135359.483762:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792256000 00000100:00100000:1.0:1783135359.483798:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 129 00000100:00100000:1.0:1783135359.483806:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792256000:12345-192.168.201.60@tcp:400: 00000100:00100000:1.0:1783135359.483861:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792256000:12345-192.168.201.60@tcp:400: Request processed in 56us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135359.483868:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 129 00000100:00100000:2.0:1783135359.484566:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+5:2360:x1869752792256384:12345-192.168.201.60@tcp:400: 00000100:00100000:2.0:1783135359.484613:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+5:2360:x1869752792256384:12345-192.168.201.60@tcp:400: Request processed in 912us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135359.484621:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:0.0:1783135359.613424:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135359.613457:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813249536:0@lo:13: 00000100:00100000:0.0:1783135359.613558:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135359.613708:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813249536 00000100:00100000:2.0:1783135359.613718:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813249536 00000100:00100000:2.0:1783135359.613805:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135359.613842:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813249536:12345-0@lo:13: 00000100:00080000:0.0:1783135359.614041:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783135359.614081:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135359.614155:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813249536:12345-0@lo:13: Request processed in 316us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135359.614163:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1783135359.614246:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3b9ded80 x1869752813249536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135359.614266:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813249536:0@lo:13: 00010000:00010000:1.0:1783135359.930075:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135360.142138:0:8151:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1783135360.954168:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135361.979026:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135362.170801:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813249792:0@lo:400: 00000100:00100000:2.0:1783135362.170937:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135362.171015:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813250304:0@lo:400: 00000100:00100000:2.0:1783135362.171197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135362.171244:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135362.171251:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813249920:0@lo:400: 00000100:00100000:2.0:1783135362.171292:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135362.171733:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813249792 00000100:00100000:2.0:1783135362.171744:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813249792 00000100:00100000:2.0:1783135362.171805:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813249920 00000100:00100000:2.0:1783135362.171809:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813249920 00000100:00100000:2.0:1783135362.171874:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135362.171886:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813249792:12345-0@lo:400: 00000100:00100000:2.0:1783135362.171966:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813249792:12345-0@lo:400: Request processed in 82us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135362.171974:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135362.171998:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135362.172005:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813249920:12345-0@lo:400: 00000100:00100000:2.0:1783135362.172615:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813249920:12345-0@lo:400: Request processed in 608us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135362.172624:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135362.172659:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813250304 00000100:00100000:2.0:1783135362.172665:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813250304 00000100:00100000:2.0:1783135362.172707:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135362.172714:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813250304:12345-0@lo:400: 00000100:00100000:2.0:1783135362.172756:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813250304:12345-0@lo:400: Request processed in 43us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135362.172762:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1783135362.172788:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135362.172793:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135362.172875:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813249920:0@lo:400: 00000100:00100000:2.0:1783135362.172889:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813249792:0@lo:400: 00010000:00080000:2.0:1783135362.172904:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bf480 x1869752813250304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135362.172929:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813250304:0@lo:400: 00000100:00100000:1.0:1783135362.173793:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813250048:0@lo:400: 00000100:00100000:1.0:1783135362.173886:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135362.173923:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783135362.173930:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813249664:0@lo:400: 00000100:00100000:1.0:1783135362.173983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135362.174018:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813250176:0@lo:400: 00000100:00100000:1.0:1783135362.174059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135362.174093:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813250048 00000100:00100000:1.0:1783135362.174099:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813250048 00000100:00100000:1.0:1783135362.174146:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135362.174156:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813250048:12345-0@lo:400: 00000100:00100000:1.0:1783135362.174204:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813250048:12345-0@lo:400: Request processed in 49us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135362.174211:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135362.174240:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813249664 00000100:00100000:1.0:1783135362.174243:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813249664 00000100:00100000:1.0:1783135362.174267:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1783135362.174272:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3313:x1869752813249664:12345-0@lo:400: 00000100:00100000:1.0:1783135362.174300:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3313:x1869752813249664:12345-0@lo:400: Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135362.174306:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1783135362.174333:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135362.174360:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813249664:0@lo:400: 00010000:00080000:1.0:1783135362.174373:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3be36d80 x1869752813250048/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135362.174383:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813250048:0@lo:400: 00000100:00100000:1.0:1783135362.174407:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813250176 00000100:00100000:1.0:1783135362.174409:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813250176 00000100:00100000:1.0:1783135362.174440:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135362.174446:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813250176:12345-0@lo:400: 00000100:00100000:1.0:1783135362.174485:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813250176:12345-0@lo:400: Request processed in 40us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135362.174491:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1783135362.174507:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135362.174521:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813250176:0@lo:400: 00000100:00100000:2.0:1783135362.683651:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813250432:0@lo:13: 00000100:00100000:2.0:1783135362.683756:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135362.683864:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813250432 00000100:00100000:1.0:1783135362.683874:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813250432 00000100:00100000:1.0:1783135362.683944:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135362.683955:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813250432:12345-0@lo:13: 00002000:00000024:1.0:1783135362.684002:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135362.684081:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813250432:12345-0@lo:13: Request processed in 126us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135362.684088:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1783135362.684383:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f02d10700 x1869752813250432/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135362.684406:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813250432:0@lo:13: 00010000:00010000:0.0:1783135363.003575:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135364.034331:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783135364.544617:0:8298:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcf3fbc10 20000000:00000080:2.0:1783135364.544642:0:8298:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8f37ab5400 uarg=0000000000000000 20000000:01000000:2.0:1783135364.544696:0:8298:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1783135364.544699:0:8298:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1783135364.544702:0:8298:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783135364.544708:0:8298:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1783135364.544714:0:8298:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1783135364.545690:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783135364.545699:0:8298:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783135364.546384:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783135364.546391:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783135364.547572:0:8299:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1783135364.548396:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1783135364.548459:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1783135364.548496:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1783135364.548509:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783135364.548512:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783135364.551670:0:8300:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1783135364.552650:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1783135364.552735:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1783135364.552772:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1783135364.552787:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1783135364.552790:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783135364.571680:0:8301:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1783135364.572415:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1783135364.572509:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1783135364.572549:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1783135364.572573:0:8298:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783135364.572577:0:8298:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1783135364.573599:0:8302:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1783135364.575417:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1783135364.575489:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1783135364.575561:0:8298:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:1.0:1783135364.575583:0:8298:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1783135364.575609:0:8298:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575631:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575640:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575648:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c816 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575667:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c824 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575674:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c832 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575681:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c84e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575689:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c878 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575701:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575709:0:8298:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575718:0:8298:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.575771:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.576004:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 9 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.576026:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813250560:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135364.576367:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 9 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.576392:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 9 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.576402:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813250688:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135364.576439:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c878 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.576448:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c878 expref: 18 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.576459:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813250816:0@lo:104: 00000100:00100000:0.0:1783135364.576511:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135364.576576:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c84e expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.576585:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c84e expref: 18 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.576594:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813250944:0@lo:104: 00000100:00100000:0.0:1783135364.576620:0:8298:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135364.576651:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c832 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.576659:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c832 expref: 18 pid: 5789 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.576667:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251072:0@lo:104: 00010000:00010000:0.0:1783135364.576692:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c824 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.576707:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c824 expref: 18 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.576715:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251200:0@lo:104: 00010000:00010000:0.0:1783135364.576744:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c816 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.576752:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c816 expref: 18 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.576760:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251328:0@lo:104: 00010000:00010000:0.0:1783135364.576795:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.576804:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 18 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.576812:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251456:0@lo:104: 00010000:00010000:0.0:1783135364.576869:0:8298:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.576878:0:8298:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 18 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.576886:0:8298:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251584:0@lo:104: 00000100:00100000:0.0:1783135364.576906:0:8298:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3ccaf6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135364.577018:0:5779:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783135364.577047:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.577070:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.577078:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.577097:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.577106:0:5779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.577116:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813250816 00000100:00100000:1.0:1783135364.577125:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813250816 00000100:00100000:1.0:1783135364.577179:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813250944 00000100:00100000:1.0:1783135364.577181:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813250944 00000100:00100000:1.0:1783135364.577191:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813251072 00000100:00100000:1.0:1783135364.577193:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813251072 00000100:00100000:1.0:1783135364.577201:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813251200 00000100:00100000:1.0:1783135364.577204:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813251200 00000100:00100000:1.0:1783135364.577212:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813251328 00000100:00100000:1.0:1783135364.577214:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813251328 00000100:00100000:1.0:1783135364.577222:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813251456 00000100:00100000:1.0:1783135364.577224:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813251456 00000100:00100000:1.0:1783135364.577233:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813251584 00000100:00100000:1.0:1783135364.577236:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813251584 00000100:00100000:1.0:1783135364.577271:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135364.577282:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:8298:x1869752813250816:12345-0@lo:104: 00010000:00010000:1.0:1783135364.577298:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577358:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135364.577366:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+9:8298:x1869752813250816:12345-0@lo:104: Request processed in 85us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.577374:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135364.577397:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135364.577404:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+8:8298:x1869752813250944:12345-0@lo:104: 00010000:00010000:1.0:1783135364.577411:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577457:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783135364.577463:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+8:8298:x1869752813250944:12345-0@lo:104: Request processed in 60us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.577470:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135364.577506:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135364.577513:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+7:8298:x1869752813251072:12345-0@lo:104: 00010000:00010000:1.0:1783135364.577520:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577559:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783135364.577564:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+7:8298:x1869752813251072:12345-0@lo:104: Request processed in 53us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.577570:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135364.577583:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135364.577590:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+6:8298:x1869752813251200:12345-0@lo:104: 00010000:00010000:1.0:1783135364.577596:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577623:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783135364.577627:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+6:8298:x1869752813251200:12345-0@lo:104: Request processed in 39us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.577633:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135364.577644:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135364.577650:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:8298:x1869752813251328:12345-0@lo:104: 00010000:00010000:1.0:1783135364.577657:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577691:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783135364.577696:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:8298:x1869752813251328:12345-0@lo:104: Request processed in 47us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.577702:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135364.577715:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135364.577721:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:8298:x1869752813251456:12345-0@lo:104: 00010000:00010000:1.0:1783135364.577728:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577752:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1783135364.577756:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:8298:x1869752813251456:12345-0@lo:104: Request processed in 37us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.577761:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135364.577774:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135364.577779:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:8298:x1869752813251584:12345-0@lo:104: 00010000:00010000:1.0:1783135364.577786:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577811:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1783135364.577844:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:8298:x1869752813251584:12345-0@lo:104: Request processed in 65us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.577849:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1783135364.577869:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1783135364.577875:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577883:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221e00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135364.577894:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577906:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135364.577914:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135364.577921:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135364.577961:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.577968:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135364.577992:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578000:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05221e00/0xf646e0cda875c878 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c87f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578017:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783135364.578020:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578027:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221c00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135364.578030:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578036:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135364.578054:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135364.578060:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135364.578076:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578082:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135364.578087:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578094:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05221c00/0xf646e0cda875c84e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c855 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578103:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783135364.578107:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578113:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135364.578116:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578122:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135364.578128:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135364.578133:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135364.578153:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578159:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135364.578178:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578184:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2200/0xf646e0cda875c832 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c839 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578194:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783135364.578197:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578202:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135364.578205:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578212:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135364.578219:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135364.578224:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135364.578234:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578240:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135364.578245:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578261:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3e00/0xf646e0cda875c824 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c82b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578271:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135364.578275:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578280:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42157200 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135364.578283:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578289:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135364.578294:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135364.578300:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135364.578314:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578320:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135364.578324:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578331:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c816 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c81d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578341:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135364.578350:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578356:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42157600 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135364.578359:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578366:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135364.578372:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135364.578377:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135364.578396:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578401:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135364.578405:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578410:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42157600/0xf646e0cda875c7ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7f3 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578420:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135364.578422:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578428:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221a00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135364.578430:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578446:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135364.578452:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135364.578457:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135364.578470:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578475:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135364.578479:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578484:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05221a00/0xf646e0cda875c7c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7c9 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.578498:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135364.578500:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135364.578501:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135364.578512:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135364.578518:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135364.578531:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813251712:0@lo:103: 00000100:00100000:1.0:1783135364.578586:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.578612:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813252224:0@lo:103: 00000100:00100000:1.0:1783135364.578632:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.578654:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783135364.578661:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813251840:0@lo:103: 00000100:00100000:1.0:1783135364.578691:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.578709:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813252352:0@lo:103: 00000100:00100000:1.0:1783135364.578730:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.578761:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813251968:0@lo:103: 00000100:00100000:1.0:1783135364.578804:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.578842:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813252480:0@lo:103: 00000100:00100000:1.0:1783135364.578865:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.578877:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135364.578882:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813252096:0@lo:103: 00000100:00100000:1.0:1783135364.578905:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.578937:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813251712 00000100:00100000:1.0:1783135364.578944:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813251712 00010000:00010000:1.0:1783135364.578971:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c878 expref: 19 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.578991:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813252224 00000100:00100000:1.0:1783135364.578993:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813252224 00010000:00010000:1.0:1783135364.579004:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c816 expref: 20 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.579015:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813251840 00000100:00100000:1.0:1783135364.579017:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813251840 00010000:00010000:1.0:1783135364.579027:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c84e expref: 21 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.579035:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813252352 00000100:00100000:1.0:1783135364.579037:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813252352 00010000:00010000:1.0:1783135364.579047:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 22 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.579071:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813251968 00000100:00100000:1.0:1783135364.579073:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813251968 00010000:00010000:1.0:1783135364.579084:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c832 expref: 23 pid: 5789 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.579093:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813252480 00000100:00100000:1.0:1783135364.579095:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813252480 00010000:00010000:1.0:1783135364.579103:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 24 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.579112:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813252096 00000100:00100000:1.0:1783135364.579114:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813252096 00010000:00010000:1.0:1783135364.579122:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c824 expref: 25 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.579133:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135364.579140:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+25:3313:x1869752813251712:12345-0@lo:103: 00010000:00010000:1.0:1783135364.579154:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135364.579160:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c878 expref: 25 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579171:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c878 expref: 25 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579191:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135364.579222:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+25:3313:x1869752813251712:12345-0@lo:103: Request processed in 82us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.579230:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135364.579247:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135364.579260:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+24:3313:x1869752813252224:12345-0@lo:103: 00010000:00010000:1.0:1783135364.579267:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135364.579272:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c816 expref: 24 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579281:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c816 expref: 24 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579290:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135364.579312:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+24:3313:x1869752813252224:12345-0@lo:103: Request processed in 53us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.579318:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135364.579332:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135364.579338:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+23:3313:x1869752813251840:12345-0@lo:103: 00010000:00010000:1.0:1783135364.579347:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135364.579351:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c84e expref: 23 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579360:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c84e expref: 23 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579370:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135364.579390:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+23:3313:x1869752813251840:12345-0@lo:103: Request processed in 52us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.579396:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135364.579407:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135364.579413:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+22:3313:x1869752813252352:12345-0@lo:103: 00010000:00010000:1.0:1783135364.579420:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135364.579430:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 22 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579438:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 22 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579447:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135364.579469:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+22:3313:x1869752813252352:12345-0@lo:103: Request processed in 56us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.579475:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135364.579489:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135364.579495:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+21:3311:x1869752813251968:12345-0@lo:103: 00010000:00010000:1.0:1783135364.579505:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135364.579509:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c832 expref: 21 pid: 5789 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579517:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c832 expref: 21 pid: 5789 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579526:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135364.579562:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+21:3311:x1869752813251968:12345-0@lo:103: Request processed in 57us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.579569:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135364.579580:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135364.579587:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+20:3311:x1869752813252480:12345-0@lo:103: 00010000:00010000:1.0:1783135364.579595:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135364.579600:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 20 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579619:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 20 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579629:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135364.579651:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+20:3311:x1869752813252480:12345-0@lo:103: Request processed in 65us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.579657:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135364.579669:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135364.579674:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813252096:12345-0@lo:103: 00010000:00010000:1.0:1783135364.579682:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135364.579687:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c824 expref: 19 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579695:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c824 expref: 19 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.579704:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135364.579725:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813252096:12345-0@lo:103: Request processed in 50us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.579731:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135364.579843:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813251840:0@lo:103: 00000100:00100000:1.0:1783135364.579855:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813252352:0@lo:103: 00000100:00100000:1.0:1783135364.579863:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813251712:0@lo:103: 00000100:00100000:1.0:1783135364.579869:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813252224:0@lo:103: 00000100:00100000:1.0:1783135364.579904:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813252096:0@lo:103: 00000100:00100000:1.0:1783135364.579922:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813251968:0@lo:103: 00000100:00100000:1.0:1783135364.579929:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813252480:0@lo:103: 00010000:00010000:0.0:1783135364.580154:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b3200/0xf646e0cda875c87f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c878 expref: 18 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.580185:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813250816:0@lo:104: 00010000:00010000:0.0:1783135364.580200:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c855 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c84e expref: 17 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.580209:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813250944:0@lo:104: 00010000:00010000:0.0:1783135364.580219:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05220000/0xf646e0cda875c839 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c832 expref: 16 pid: 5789 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.580227:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251072:0@lo:104: 00010000:00010000:0.0:1783135364.580236:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156a00/0xf646e0cda875c82b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c824 expref: 15 pid: 5787 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.580256:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251200:0@lo:104: 00010000:00010000:0.0:1783135364.580266:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05220a00/0xf646e0cda875c81d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c816 expref: 14 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.580275:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251328:0@lo:104: 00010000:00010000:0.0:1783135364.580285:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c7f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c7ec expref: 13 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.580293:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251456:0@lo:104: 00010000:00010000:0.0:1783135364.580303:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05220400/0xf646e0cda875c7c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c7c2 expref: 12 pid: 5788 timeout: 414 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.580312:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813251584:0@lo:104: 00000100:00100000:3.0:1783135364.609051:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135364.609107:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135364.609151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135364.609211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135364.609377:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792256512 00000100:00100000:1.0:1783135364.609393:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792256512 00000100:00100000:1.0:1783135364.609464:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 131 00000100:00100000:1.0:1783135364.609480:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792256512:12345-192.168.201.60@tcp:400: 00000100:00100000:0.0:1783135364.609605:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792256640 00000100:00100000:0.0:1783135364.609618:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792256640 00000100:00100000:0.0:1783135364.609679:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:0.0:1783135364.609690:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792256640:12345-192.168.201.60@tcp:400: 00000100:00100000:2.0:1783135364.609773:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792256768 00000100:00100000:2.0:1783135364.609779:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792256768 00000100:00100000:2.0:1783135364.609860:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792256896 00000100:00100000:2.0:1783135364.609864:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792256896 00000100:00100000:2.0:1783135364.609884:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:2.0:1783135364.609892:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792256768:12345-192.168.201.60@tcp:400: 00000100:00100000:1.0:1783135364.613599:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792256512:12345-192.168.201.60@tcp:400: Request processed in 4099us (4542us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.613620:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 131 00000100:00100000:1.0:1783135364.613724:0:6587:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1783135364.613734:0:6587:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:1.0:1783135364.613762:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135364.613769:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135364.613773:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135364.615163:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:1.0:1783135364.615193:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792256896:12345-192.168.201.60@tcp:400: 00000100:00100000:0.0:1783135364.615440:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792256640:12345-192.168.201.60@tcp:400: Request processed in 5747us (6283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135364.615453:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:0.0:1783135364.615545:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813250560:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135364.615645:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792256896:12345-192.168.201.60@tcp:400: Request processed in 464us (6431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.615653:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:2.0:1783135364.617640:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792256768:12345-192.168.201.60@tcp:400: Request processed in 7732us (8515us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135364.617668:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:0.0:1783135364.619753:0:8298:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8298:1869752813250688:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135364.620050:0:8298:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135364.620140:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135364.620217:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135364.620447:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792257024 00000100:00100000:1.0:1783135364.620458:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792257024 00010000:00010000:1.0:1783135364.620505:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 10 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.620564:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792257152 00000100:00100000:1.0:1783135364.620568:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792257152 00010000:00010000:1.0:1783135364.620584:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 11 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135364.620635:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:1.0:1783135364.620657:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:2361:x1869752792257024:12345-192.168.201.60@tcp:103: 00010000:00010000:1.0:1783135364.620677:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135364.620683:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 11 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.620696:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 11 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.620718:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c894 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cc6 expref: 11 pid: 5787 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135364.620738:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135364.620804:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792257024:12345-192.168.201.60@tcp:103: Request processed in 159us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.621073:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:0.0:1783135364.621364:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:0.0:1783135364.621381:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:2361:x1869752792257152:12345-192.168.201.60@tcp:103: 00010000:00010000:0.0:1783135364.621393:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135364.621398:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 9 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621409:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 9 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621424:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875c88d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cbf expref: 9 pid: 5789 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621440:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621471:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621493:0:6604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621501:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621509:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621518:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621537:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42156200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135364.621543:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621561:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621582:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621593:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135364.621630:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:2361:x1869752792257152:12345-192.168.201.60@tcp:103: Request processed in 256us (1412us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135364.621639:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 20 00010000:00010000:0.0:1783135364.621715:0:8298:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621732:0:8298:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135364.621740:0:8298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c8cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8298 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135364.735603:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813252608:0@lo:13: 00000100:00100000:3.0:1783135364.735721:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135364.736048:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813252608 00000100:00100000:1.0:1783135364.736058:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813252608 00000100:00100000:1.0:1783135364.736146:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135364.736158:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813252608:12345-0@lo:13: 00000100:00080000:2.0:1783135364.736292:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1783135364.736340:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135364.736415:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813252608:12345-0@lo:13: Request processed in 259us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135364.736424:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1783135364.736611:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb6a00 x1869752813252608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135364.736639:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813252608:0@lo:13: 00010000:00010000:1.0:1783135365.056935:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135366.074068:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783135366.074709:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783135366.074717:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8e0182b800 from 39 10000000:01000000:0.0:1783135366.074726:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783135366.074810:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.074848:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.074864:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135366.075040:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813252736:0@lo:101: 00000100:00100000:0.0:1783135366.075144:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.075288:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02bf6a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.075850:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813252736 00000100:00100000:1.0:1783135366.075864:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813252736 00000100:00100000:1.0:1783135366.076246:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783135366.076259:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+12:5791:x1869752813252736:12345-0@lo:101: 00010000:00010000:1.0:1783135366.076281:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135366.076304:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42157a00/0xf646e0cda875c8da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c8d3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.076336:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42157a00/0xf646e0cda875c8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c8d3 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.076349:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42157a00/0xf646e0cda875c8da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c8d3 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.076372:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42157a00, rc 0) 00000100:00100000:1.0:1783135366.076457:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813252736:12345-0@lo:101: Request processed in 201us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.076464:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783135366.076595:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813252736:0@lo:101: 00010000:00010000:2.0:1783135366.076616:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.076627:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135366.076728:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813252864:0@lo:501: 00000100:00100000:2.0:1783135366.076780:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.078075:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04db2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.078629:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813252864 00000100:00100000:0.0:1783135366.078642:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813252864 00000100:00100000:0.0:1783135366.078710:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1783135366.078722:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813252864:12345-0@lo:501: 00000100:00100000:0.0:1783135366.079560:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813252864:12345-0@lo:501: Request processed in 834us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.079572:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783135366.079901:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813252864:0@lo:501: 00000100:00100000:2.0:1783135366.079988:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813252992:0@lo:503: 00000100:00100000:2.0:1783135366.080050:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.080099:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04db2480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.080621:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813252992 00000100:00100000:0.0:1783135366.080630:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813252992 00000100:00100000:0.0:1783135366.080674:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783135366.080684:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813252992:12345-0@lo:503: 00000100:00100000:0.0:1783135366.081282:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813252992:12345-0@lo:503: Request processed in 595us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.081292:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783135366.081638:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813252992:0@lo:503: 00000100:00100000:2.0:1783135366.083345:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8317:1869752813253120:0@lo:502: 00000100:00100000:2.0:1783135366.083675:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.083733:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04db2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.083891:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813253120 00000100:00100000:0.0:1783135366.083900:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813253120 00000100:00100000:0.0:1783135366.084300:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1783135366.084315:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:8317:x1869752813253120:12345-0@lo:502: 00000100:00100000:0.0:1783135366.084713:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:8317:x1869752813253120:12345-0@lo:502: Request processed in 401us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.084723:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1783135366.085570:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8317:1869752813253120:0@lo:502: 00000100:00100000:2.0:1783135366.085676:0:8317:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8317:1869752813253248:0@lo:502: 00000100:00100000:2.0:1783135366.085756:0:8317:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.088665:0:8317:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0579b480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.088752:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813253248 00000100:00100000:3.0:1783135366.088776:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813253248 00000100:00100000:3.0:1783135366.088885:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1783135366.088898:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:8317:x1869752813253248:12345-0@lo:502: 00000100:00100000:3.0:1783135366.089785:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:8317:x1869752813253248:12345-0@lo:502: Request processed in 884us (4023us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.089797:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1783135366.090003:0:8317:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8317:1869752813253248:0@lo:502: 00000040:00080000:2.0:1783135366.090056:0:8317:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783135366.090620:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1783135366.090645:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135366.090659:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.090672:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135366.090685:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1783135366.090688:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1783135366.090691:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1783135366.090734:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.090745:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.091205:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135366.091290:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813253376:0@lo:101: 00000100:00100000:3.0:1783135366.091421:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.091465:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c09cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.091775:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813253376 00000100:00100000:2.0:1783135366.091783:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813253376 00000100:00100000:2.0:1783135366.091849:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1783135366.091860:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+13:5791:x1869752813253376:12345-0@lo:101: 00010000:00010000:2.0:1783135366.091887:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135366.091907:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b2600/0xf646e0cda875c8e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c8e1 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.091947:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b2600/0xf646e0cda875c8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c8e1 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.091967:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b2600/0xf646e0cda875c8e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c8e1 expref: 14 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.091977:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2600, rc 0) 00000100:00100000:2.0:1783135366.092025:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813253376:12345-0@lo:101: Request processed in 167us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.092045:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783135366.092704:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813253376:0@lo:101: 00010000:00010000:3.0:1783135366.092726:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.092736:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135366.093050:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813253504:0@lo:501: 00000100:00100000:3.0:1783135366.093171:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.093207:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c09cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.093449:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813253504 00000100:00100000:2.0:1783135366.093455:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813253504 00000100:00100000:2.0:1783135366.093501:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1783135366.093512:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813253504:12345-0@lo:501: 00000100:00100000:2.0:1783135366.099670:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813253504:12345-0@lo:501: Request processed in 6142us (6481us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.099690:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783135366.102635:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813253504:0@lo:501: 00000100:00100000:3.0:1783135366.102731:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813253632:0@lo:503: 00000100:00100000:3.0:1783135366.103241:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.103384:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c09cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.103584:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813253632 00000100:00100000:0.0:1783135366.103593:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813253632 00000100:00100000:0.0:1783135366.103699:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783135366.103712:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813253632:12345-0@lo:503: 00000100:00100000:0.0:1783135366.104056:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813253632:12345-0@lo:503: Request processed in 345us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.104067:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1783135366.104179:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813253632:0@lo:503: 00000100:00100000:3.0:1783135366.105015:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8318:1869752813253760:0@lo:502: 00000100:00100000:3.0:1783135366.105232:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.105749:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c09480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.105913:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813253760 00000100:00100000:2.0:1783135366.105924:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813253760 00000100:00100000:2.0:1783135366.106592:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783135366.106607:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:8318:x1869752813253760:12345-0@lo:502: 00000100:00100000:2.0:1783135366.107277:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:8318:x1869752813253760:12345-0@lo:502: Request processed in 669us (2178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.107288:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783135366.107577:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8318:1869752813253760:0@lo:502: 00000020:01000000:3.0:1783135366.107637:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135366.107651:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135366.107654:0:8318:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783135366.107664:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783135366.107717:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8318:1869752813253888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135366.107777:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135366.107855:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.108041:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813253888 00000100:00100000:2.0:1783135366.108051:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813253888 00000100:00100000:2.0:1783135366.108091:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783135366.108196:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:8318:x1869752813253888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135366.108786:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:8318:x1869752813253888:12345-0@lo:502:llog_process_th.0 Request processed in 590us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.108797:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783135366.109015:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8318:1869752813253888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135366.109053:0:8318:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135366.109063:0:8318:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135366.109067:0:8318:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783135366.109074:0:8318:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1783135366.109634:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1783135366.109658:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1783135366.109673:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.109686:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135366.109699:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783135366.109702:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f04f38800 from 39 10000000:01000000:1.0:1783135366.109706:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783135366.109746:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.109768:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.109779:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135366.109805:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.109903:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.109963:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3f6c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.110135:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813254016 00000100:00100000:3.0:1783135366.110145:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813254016 00000100:00100000:3.0:1783135366.110241:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783135366.110252:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:5791:x1869752813254016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135366.110269:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135366.110285:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487400/0xf646e0cda875c8f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c8ef expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.110315:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487400/0xf646e0cda875c8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c8ef expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.110329:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c487400/0xf646e0cda875c8f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c8ef expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.110340:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487400, rc 0) 00000100:00100000:3.0:1783135366.110608:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813254016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 356us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.110631:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1783135366.110884:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135366.110902:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.110913:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135366.110989:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.111023:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.111048:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3f6c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.111063:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813254144 00000100:00100000:1.0:1783135366.111067:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813254144 00000100:00100000:1.0:1783135366.111089:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783135366.111110:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813254144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.111665:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813254144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 553us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.111674:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783135366.111730:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.111764:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.111809:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.111848:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f1069fe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.111861:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813254272 00000100:00100000:1.0:1783135366.111865:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813254272 00000100:00100000:1.0:1783135366.111896:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783135366.111903:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813254272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.112194:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813254272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 290us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.112201:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1783135366.112239:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.112658:0:8319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8319:1869752813254400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135366.112697:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.112719:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813254400 00000100:00100000:1.0:1783135366.112723:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813254400 00000100:00100000:1.0:1783135366.112745:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783135366.112753:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:8319:x1869752813254400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135366.113319:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:8319:x1869752813254400:12345-0@lo:502:llog_process_th.0 Request processed in 561us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.113329:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783135366.113458:0:8319:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3f6c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.113477:0:8319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8319:1869752813254400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135366.113550:0:8319:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8319:1869752813254528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135366.113596:0:8319:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135366.113622:0:8319:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d900 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.113855:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813254528 00000100:00100000:3.0:1783135366.113861:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813254528 00000100:00100000:3.0:1783135366.114081:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783135366.114092:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:8319:x1869752813254528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135366.114539:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:8319:x1869752813254528:12345-0@lo:502:llog_process_th.0 Request processed in 447us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.114547:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783135366.114640:0:8319:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8319:1869752813254528:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783135366.114667:0:8319:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1783135366.115559:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1783135366.115596:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135366.115612:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.115646:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135366.115657:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783135366.115661:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1783135366.115664:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783135366.115709:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.115719:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.115731:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135366.115764:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.116205:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.116291:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3db37300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.116599:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813254656 00000100:00100000:1.0:1783135366.116609:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813254656 00000100:00100000:1.0:1783135366.116671:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783135366.116682:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:5791:x1869752813254656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135366.116701:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135366.116721:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c904 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c8fd expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.116752:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c8fd expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.116767:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c904 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c8fd expref: 16 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.116780:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42156200, rc 0) 00000100:00100000:1.0:1783135366.117206:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813254656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 522us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.117214:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1783135366.117436:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135366.117456:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.117468:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135366.117569:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.117608:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.117697:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3db37300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.117731:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813254784 00000100:00100000:0.0:1783135366.117738:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813254784 00000100:00100000:0.0:1783135366.117843:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783135366.117853:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813254784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.118499:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813254784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 643us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.118519:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783135366.118606:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.118652:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.118706:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.119152:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3db37300 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.119274:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813254912 00000100:00100000:3.0:1783135366.119281:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813254912 00000100:00100000:3.0:1783135366.119327:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1783135366.119337:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813254912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135366.119660:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813254912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 323us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.119668:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783135366.119791:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813254912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.120487:0:8320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8320:1869752813255040:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135366.120562:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.120604:0:8320:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.120657:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813255040 00000100:00100000:3.0:1783135366.120662:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813255040 00000100:00100000:3.0:1783135366.120704:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1783135366.120715:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:8320:x1869752813255040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135366.121221:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:8320:x1869752813255040:12345-0@lo:502:llog_process_th.0 Request processed in 505us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.121231:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783135366.121443:0:8320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8320:1869752813255040:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135366.121475:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135366.121488:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135366.121491:0:8320:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783135366.121498:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783135366.121543:0:8320:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8320:1869752813255168:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135366.121586:0:8320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.121625:0:8320:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.121675:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813255168 00000100:00100000:2.0:1783135366.121681:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813255168 00000100:00100000:2.0:1783135366.121723:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783135366.121732:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:8320:x1869752813255168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135366.121944:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:8320:x1869752813255168:12345-0@lo:502:llog_process_th.0 Request processed in 212us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.122540:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783135366.122865:0:8320:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8320:1869752813255168:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135366.123010:0:8320:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135366.123020:0:8320:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135366.123022:0:8320:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783135366.123029:0:8320:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1783135366.123502:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1783135366.123543:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783135366.123557:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.123570:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135366.123582:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783135366.123586:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f063e9800 from 39 10000000:01000000:2.0:1783135366.123589:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135366.123626:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.123636:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.123658:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135366.123682:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813255296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.123737:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.123781:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.124048:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813255296 00000100:00100000:3.0:1783135366.124056:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813255296 00000100:00100000:3.0:1783135366.124206:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783135366.124218:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813255296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135366.124242:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135366.124258:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487e00/0xf646e0cda875c912 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c90b expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.124287:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487e00/0xf646e0cda875c912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c90b expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.124299:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c487e00/0xf646e0cda875c912 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c90b expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135366.124310:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487e00, rc 0) 00000100:00100000:3.0:1783135366.124735:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813255296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.124744:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783135366.125707:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813255296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135366.125735:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.125748:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135366.126268:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813255424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.126336:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.126491:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.126601:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813255424 00000100:00100000:1.0:1783135366.126611:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813255424 00000100:00100000:1.0:1783135366.126703:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783135366.126715:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813255424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.127141:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813255424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 426us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.127159:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1783135366.127251:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813255424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.127295:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813255552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.127341:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.128070:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.128248:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813255552 00000100:00100000:0.0:1783135366.128256:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813255552 00000100:00100000:0.0:1783135366.128305:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783135366.128317:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813255552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.128647:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813255552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.128655:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783135366.128758:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813255552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.129769:0:8321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8321:1869752813255680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135366.129894:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.129940:0:8321:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.130228:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813255680 00000100:00100000:0.0:1783135366.130235:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813255680 00000100:00100000:0.0:1783135366.130289:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1783135366.130300:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:8321:x1869752813255680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135366.130649:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:8321:x1869752813255680:12345-0@lo:502:llog_process_th.0 Request processed in 348us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.130658:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783135366.131059:0:8321:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8321:1869752813255680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135366.131212:0:8321:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8321:1869752813255808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135366.131265:0:8321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135366.131301:0:8321:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135366.131804:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813255808 00000100:00100000:0.0:1783135366.131812:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813255808 00000100:00100000:0.0:1783135366.131940:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1783135366.132014:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:8321:x1869752813255808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135366.132440:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:8321:x1869752813255808:12345-0@lo:502:llog_process_th.0 Request processed in 489us (1173us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.132448:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783135366.132611:0:8321:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8321:1869752813255808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1783135366.132643:0:8321:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783135366.133122:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783135366.133146:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783135366.133158:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.133171:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135366.133182:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1783135366.133186:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1783135366.133189:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783135366.133232:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.133242:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.133267:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135366.133290:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813255936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.133341:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.133393:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.133672:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813255936 00000100:00100000:2.0:1783135366.133680:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813255936 00000100:00100000:2.0:1783135366.133722:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783135366.133733:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813255936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135366.133749:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135366.133765:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b3000/0xf646e0cda875c920 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c919 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.133794:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b3000/0xf646e0cda875c920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c919 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.133806:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b3000/0xf646e0cda875c920 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c919 expref: 18 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135366.133843:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3000, rc 0) 00000100:00100000:2.0:1783135366.133901:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813255936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.133908:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783135366.134238:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813255936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135366.134260:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.134271:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135366.134337:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813256064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.134384:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.134418:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.134521:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813256064 00000100:00100000:2.0:1783135366.134536:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813256064 00000100:00100000:2.0:1783135366.134573:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1783135366.134582:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813256064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.135183:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813256064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 599us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.135193:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1783135366.135796:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813256064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.136167:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813256192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.136244:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.136287:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052053c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135366.136431:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813256192 00000100:00100000:2.0:1783135366.136439:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813256192 00000100:00100000:2.0:1783135366.136498:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1783135366.136510:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813256192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135366.136754:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813256192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135366.136762:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1783135366.137188:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813256192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.137801:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8322:1869752813256320:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135366.138175:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.138244:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135366.138309:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813256320 00000100:00100000:3.0:1783135366.138315:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813256320 00000100:00100000:3.0:1783135366.138656:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783135366.138667:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:8322:x1869752813256320:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135366.139264:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:8322:x1869752813256320:12345-0@lo:502:llog_process_th.0 Request processed in 595us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135366.139273:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783135366.139487:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8322:1869752813256320:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135366.139522:0:8322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135366.139546:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135366.139548:0:8322:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783135366.139556:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1783135366.139587:0:8322:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8322:1869752813256448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135366.139630:0:8322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.139927:0:8322:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.140149:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813256448 00000100:00100000:1.0:1783135366.140157:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813256448 00000100:00100000:0.0:1783135366.140250:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783135366.140259:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:8322:x1869752813256448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135366.140590:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:8322:x1869752813256448:12345-0@lo:502:llog_process_th.0 Request processed in 330us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135366.140598:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783135366.140688:0:8322:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8322:1869752813256448:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135366.140715:0:8322:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135366.140795:0:8322:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135366.140799:0:8322:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783135366.140805:0:8322:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1783135366.142589:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1783135366.142629:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783135366.142646:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.142662:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135366.142675:0:5791:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783135366.142679:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8f062a19c0 from 1 10000000:01000000:0.0:1783135366.142683:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783135366.142746:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.142755:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.142796:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135366.143079:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813256576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.143180:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.143236:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.143403:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813256576 00000100:00100000:1.0:1783135366.143413:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813256576 00000100:00100000:1.0:1783135366.143465:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783135366.143477:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813256576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135366.143494:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135366.143510:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c92e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c927 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.143553:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c927 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.143566:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c92e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c927 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135366.143578:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42157600, rc 0) 00000100:00100000:1.0:1783135366.143633:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813256576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135366.143641:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783135366.144191:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813256576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135366.144212:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c92e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.144224:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c92e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135366.144314:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813256704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135366.144363:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135366.144399:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135366.144494:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813256704 00000100:00100000:1.0:1783135366.144500:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813256704 00000100:00100000:1.0:1783135366.144565:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783135366.144574:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813256704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135366.145582:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813256704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1002us (1211us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135366.145596:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783135366.145751:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813256704:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783135366.145811:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783135366.145863:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c92e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135366.146242:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c92e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135367.098353:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135367.291964:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135367.292196:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135367.292226:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813256960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.292347:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135367.293386:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813256960 00000100:00100000:2.0:1783135367.293401:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813256960 00000100:00100000:2.0:1783135367.293488:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783135367.293500:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813256960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135367.293938:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813256960:12345-0@lo:400:kworker.0 Request processed in 439us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135367.293947:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135367.294109:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813256960:0@lo:400:kworker.0 00000100:00100000:0.0:1783135367.299051:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813256832:0@lo:400:kworker.0 00000100:00100000:0.0:1783135367.299188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135367.299444:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813256832 00000100:00100000:3.0:1783135367.299455:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813256832 00000100:00100000:3.0:1783135367.299550:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783135367.299563:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3314:x1869752813256832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.299657:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3314:x1869752813256832:12345-0@lo:400:kworker.0 Request processed in 96us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135367.299666:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1783135367.300300:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813256832:0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.305493:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813257216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.305628:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135367.305691:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135367.305698:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813257088:0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.305727:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135367.305766:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813257344:0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.305795:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135367.305846:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135367.305852:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813257472:0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.305874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135367.305905:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813257088 00000100:00100000:3.0:1783135367.305915:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813257088 00000100:00100000:3.0:1783135367.305982:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813257344 00000100:00100000:3.0:1783135367.305985:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813257344 00000100:00100000:3.0:1783135367.306010:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135367.306019:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813257088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.306083:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813257088:12345-0@lo:400:kworker.0 Request processed in 64us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135367.306091:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135367.306115:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783135367.306121:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813257344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.306170:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813257344:12345-0@lo:400:kworker.0 Request processed in 49us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135367.306176:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1783135367.306193:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135367.306227:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813257088:0@lo:400:kworker.0 00000100:00100000:3.0:1783135367.306257:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813257344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135367.306667:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813257216 00000100:00100000:1.0:1783135367.306673:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813257216 00000100:00100000:1.0:1783135367.306719:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813257472 00000100:00100000:1.0:1783135367.306721:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813257472 00000100:00100000:1.0:1783135367.306743:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135367.306751:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813257216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135367.306797:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813257216:12345-0@lo:400:kworker.0 Request processed in 47us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135367.306830:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135367.306850:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135367.306857:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813257472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135367.306889:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813257472:12345-0@lo:400:kworker.0 Request processed in 33us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135367.306895:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1783135367.307086:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135367.307091:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135367.307119:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb4e00 x1869752813257216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135367.307134:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813257216:0@lo:400:kworker.0 00010000:00080000:3.0:1783135367.307164:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb7480 x1869752813257472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135367.307174:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813257472:0@lo:400:kworker.0 00000100:00100000:2.0:1783135367.352011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135367.355798:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792257280 00000100:00100000:0.0:1783135367.355858:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792257280 00000100:00100000:0.0:1783135367.355963:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 165 00000100:00100000:0.0:1783135367.355978:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:5578:x1869752792257280:12345-192.168.201.60@tcp:101: 00010000:00010000:0.0:1783135367.356007:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135367.356036:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c935 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d28 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135367.356078:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d28 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135367.356092:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c935 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d28 expref: 9 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135367.356103:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05220800, rc 0) 00000100:00100000:0.0:1783135367.356195:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5578:x1869752792257280:12345-192.168.201.60@tcp:101: Request processed in 221us (4201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135367.356205:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 165 00000100:00100000:1.0:1783135367.360565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135367.361445:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792257408 00000100:00100000:0.0:1783135367.361465:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792257408 00000100:00100000:0.0:1783135367.361571:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 166 00000100:00100000:0.0:1783135367.361586:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5578:x1869752792257408:12345-192.168.201.60@tcp:501: 00000100:00100000:0.0:1783135367.362113:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5578:x1869752792257408:12345-192.168.201.60@tcp:501: Request processed in 528us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135367.362124:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 166 00000100:00100000:3.0:1783135367.364749:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135367.365021:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792257536 00000100:00100000:2.0:1783135367.365034:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792257536 00000100:00100000:2.0:1783135367.365105:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 167 00000100:00100000:2.0:1783135367.365117:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5578:x1869752792257536:12345-192.168.201.60@tcp:503: 00000100:00100000:2.0:1783135367.365420:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5578:x1869752792257536:12345-192.168.201.60@tcp:503: Request processed in 305us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135367.365439:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 167 00000100:00100000:1.0:1783135367.370434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135367.370846:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792257664 00000100:00100000:2.0:1783135367.370861:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792257664 00000100:00100000:2.0:1783135367.370937:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 168 00000100:00100000:2.0:1783135367.370949:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:6057:x1869752792257664:12345-192.168.201.60@tcp:502: 00000100:00100000:3.0:1783135367.375937:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:6057:x1869752792257664:12345-192.168.201.60@tcp:502: Request processed in 4969us (5500us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135367.375957:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 168 00000100:00100000:1.0:1783135367.379048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135367.379571:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792257792 00000100:00100000:0.0:1783135367.379616:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792257792 00000100:00100000:1.0:1783135367.379777:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 169 00000100:00100000:1.0:1783135367.379792:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:6057:x1869752792257792:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135367.380445:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:6057:x1869752792257792:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 653us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135367.380465:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 169 00000100:00100000:0.0:1783135367.387618:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135367.391177:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792257920 00000100:00100000:1.0:1783135367.391200:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792257920 00000100:00100000:1.0:1783135367.391311:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 170 00000100:00100000:1.0:1783135367.391324:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5578:x1869752792257920:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135367.391349:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135367.391373:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c93c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d2f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135367.391412:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d2f expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135367.391426:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c93c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d2f expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135367.391436:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42156c00, rc 0) 00000100:00100000:1.0:1783135367.392083:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5578:x1869752792257920:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 Request processed in 754us (4483us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135367.392094:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 170 00000100:00100000:2.0:1783135367.406478:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135367.406939:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792258048 00000100:00100000:0.0:1783135367.406954:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792258048 00000100:00100000:0.0:1783135367.407042:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 171 00000100:00100000:0.0:1783135367.407055:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5578:x1869752792258048:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135367.407534:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5578:x1869752792258048:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 Request processed in 470us (1061us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135367.407557:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 171 00000100:00100000:3.0:1783135367.802725:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135367.802761:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813257600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135367.802881:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135367.802971:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813257600 00000100:00100000:0.0:1783135367.802983:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813257600 00000100:00100000:0.0:1783135367.803043:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135367.803066:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813257600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135367.803120:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135367.803195:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813257600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (313us total) trans 0 rc 0/0 00010000:00080000:3.0:1783135367.803370:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb5f80 x1869752813257600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135367.803394:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813257600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135367.803467:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1783135368.122571:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783135369.154235:0:8360:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff375d5880 20000000:00000080:2.0:1783135369.154255:0:8360:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8f3d12cc00 uarg=0000000000000000 20000000:01000000:2.0:1783135369.154343:0:8360:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783135369.154349:0:8360:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783135369.154355:0:8360:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00010000:00010000:1.0:1783135369.155492:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135369.156137:0:8361:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1783135369.156311:0:8360:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1783135369.161794:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1783135369.161891:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1783135369.161943:0:8360:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1783135369.161964:0:8360:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783135369.162274:0:8360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.162298:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f123b2400/0xf646e0cda875c6b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.162306:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c713 expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.162314:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c7de expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.162324:0:8360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.162332:0:8360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.162490:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.162507:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 9 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.162523:0:8360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1869752813257728:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135369.162809:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c7de expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.162867:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c7de expref: 18 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.162877:0:8360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1869752813257856:0@lo:104: 00000100:00100000:3.0:1783135369.162924:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135369.163085:0:5779:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813257856 00000100:00100000:0.0:1783135369.163097:0:5779:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813257856 00000100:00100000:0.0:1783135369.163156:0:5779:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135369.163166:0:5779:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:8360:x1869752813257856:12345-0@lo:104: 00010000:00010000:0.0:1783135369.163178:0:5779:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.163228:0:5779:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135369.163234:0:5779:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:8360:x1869752813257856:12345-0@lo:104: Request processed in 71us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.163241:0:5779:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1783135369.163275:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135369.163280:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.163288:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2a00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:0.0:1783135369.163293:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.163301:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135369.163309:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135369.163315:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783135369.163341:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.163348:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135369.163381:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.163387:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2a00/0xf646e0cda875c7de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c7e5 expref: -99 pid: 7476 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.163400:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135369.163402:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135369.163404:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135369.163432:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813258112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135369.163460:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135369.163512:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813258112 00000100:00100000:0.0:1783135369.163521:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813258112 00010000:00010000:0.0:1783135369.163541:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c7de expref: 19 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135369.163564:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135369.163571:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813258112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135369.163582:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135369.163588:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c7de expref: 19 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.163615:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c713 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.163625:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c713 expref: 19 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.163635:0:8360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1869752813257984:0@lo:104: 00000100:00100000:3.0:1783135369.163663:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135369.164520:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783135369.164536:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813257984 00000100:00100000:2.0:1783135369.164540:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813257984 00000100:00100000:2.0:1783135369.164574:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135369.164582:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d918c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:8360:x1869752813257984:12345-0@lo:104: 00010000:00010000:2.0:1783135369.164592:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.164640:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135369.164646:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d918c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:8360:x1869752813257984:12345-0@lo:104: Request processed in 66us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135369.164652:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1783135369.164782:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135369.164788:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.164810:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f029c8200 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135369.164831:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.164841:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135369.164848:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135369.164852:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135369.164880:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.164887:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135369.164912:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.164919:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8200/0xf646e0cda875c713 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c71a expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.164930:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135369.164932:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135369.164934:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135369.164941:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135369.164953:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813258240:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135369.165298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135369.165344:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813258240 00000100:00100000:2.0:1783135369.165348:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813258240 00010000:00010000:2.0:1783135369.165387:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c713 expref: 20 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135369.165411:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135369.165418:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+20:3314:x1869752813258240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135369.165427:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135369.165431:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c713 expref: 20 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.165610:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c7de expref: 20 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.165631:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135369.165671:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+20:3312:x1869752813258112:12345-0@lo:103:ldlm_bl.0 Request processed in 2101us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.165679:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135369.165728:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813258112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135369.165888:0:8360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f123b2400/0xf646e0cda875c6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.165900:0:8360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f123b2400/0xf646e0cda875c6b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 19 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.165912:0:8360:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1869752813258368:0@lo:104: 00000100:00100000:3.0:1783135369.165942:0:8360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.165965:0:8360:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0985c480 going to sleep for 11 seconds 00010000:00010000:3.0:1783135369.166047:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c7e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c7de expref: 19 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.166058:0:8360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1869752813257856:0@lo:104: 00000100:00100000:3.0:1783135369.166068:0:8360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1869752813257984:0@lo:104: 00000100:00100000:0.0:1783135369.166932:0:7482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813258368 00000100:00100000:0.0:1783135369.166942:0:7482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813258368 00000100:00100000:0.0:1783135369.167079:0:7482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783135369.167092:0:7482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:8360:x1869752813258368:12345-0@lo:104: 00010000:00010000:0.0:1783135369.167108:0:7482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.167272:0:7482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135369.167279:0:7482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:8360:x1869752813258368:12345-0@lo:104: Request processed in 191us (1336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.167285:0:7482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1783135369.167701:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135369.167709:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.167718:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135369.167722:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.167738:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135369.167746:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135369.167752:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135369.167801:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.167808:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135369.167865:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.167872:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2c00/0xf646e0cda875c6b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c6b8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.167891:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135369.167893:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135369.167895:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135369.168210:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c713 expref: 18 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.168226:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f029c8e00/0xf646e0cda875c71a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c713 expref: 18 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135369.168238:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135369.168277:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813258496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135369.168324:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135369.168552:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813258496 00000100:00100000:1.0:1783135369.168559:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813258496 00010000:00010000:1.0:1783135369.168590:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f123b2400/0xf646e0cda875c6b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 18 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135369.168625:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783135369.168632:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:3314:x1869752813258496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135369.168645:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135369.168650:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f123b2400/0xf646e0cda875c6b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 18 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.168667:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f123b2400/0xf646e0cda875c6b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 18 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135369.168678:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135369.168717:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:3314:x1869752813258496:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.168723:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135369.169065:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813258496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135369.169994:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:3314:x1869752813258240:12345-0@lo:103:ldlm_bl.0 Request processed in 4573us (4692us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135369.170004:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783135369.170134:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813258240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135369.178001:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b2400/0xf646e0cda875c6b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c6b1 expref: 16 pid: 5789 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135369.178047:0:8360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1869752813258368:0@lo:104: 00000100:00100000:2.0:1783135369.180059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135369.180257:0:8360:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8360:1869752813257728:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135369.180294:0:8360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135369.182573:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792258176 00000100:00100000:0.0:1783135369.182590:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792258176 00010000:00010000:0.0:1783135369.182654:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 10 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135369.182717:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:0.0:1783135369.182728:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2360:x1869752792258176:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135369.182749:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135369.182755:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 10 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182768:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 10 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182798:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156000/0xf646e0cda875c8a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf7 expref: 10 pid: 5787 timeout: 368 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182837:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182847:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182863:0:5782:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182871:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182896:0:5782:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182903:0:5782:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182910:0:5782:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135369.182915:0:5782:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182924:0:5782:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182939:0:5782:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135369.182950:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135369.183528:0:8360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.183540:0:8360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135369.183547:0:8360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c943 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135369.186908:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:2360:x1869752792258176:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4171us (7083us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135369.186923:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:1.0:1783135369.719842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135369.719885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135369.719916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135369.719945:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792258432 00000100:00100000:1.0:1783135369.719956:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792258432 00000100:00100000:1.0:1783135369.720017:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792258560 00000100:00100000:1.0:1783135369.720020:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792258560 00000100:00100000:1.0:1783135369.720043:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:1.0:1783135369.720053:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792258432:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135369.720126:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792258432:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 75us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.720133:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:1.0:1783135369.720154:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:1.0:1783135369.720160:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792258560:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135369.720184:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792258560:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 24us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135369.720190:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00080000:1.0:1783135369.720206:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135369.720210:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135369.720530:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792258304 00000100:00100000:3.0:1783135369.720535:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792258304 00000100:00100000:3.0:1783135369.721517:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:3.0:1783135369.721530:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792258304:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135369.721587:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792258304:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 61us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.721594:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00080000:1.0:1783135369.727576:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135369.851524:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135369.851556:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813258624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135369.851655:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135369.851921:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813258624 00000100:00100000:3.0:1783135369.851930:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813258624 00000100:00100000:3.0:1783135369.852015:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135369.852029:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813258624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135369.852086:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135369.852176:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813258624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 150us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135369.852184:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1783135369.852259:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783135369.852327:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb7100 x1869752813258624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135369.852359:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813258624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135370.171547:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135370.426710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135370.426862:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792258688 00000100:00100000:3.0:1783135370.426875:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792258688 00000100:00100000:3.0:1783135370.426937:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 172 00000100:00100000:3.0:1783135370.426948:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:5578:x1869752792258688:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135370.426964:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135370.426986:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d36 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135370.427016:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135370.427027:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 10 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135370.427038:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487c00, rc 0) 00000100:00100000:3.0:1783135370.427105:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5578:x1869752792258688:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 Request processed in 158us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135370.427113:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 172 10000000:01000000:2.0:1783135370.429480:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135370.429490:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8e0182b800 from 4 10000000:01000000:2.0:1783135370.429496:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135370.429537:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135370.429549:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135370.429560:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135370.429585:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813258752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135370.429652:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135370.429708:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.429766:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813258752 00000100:00100000:1.0:1783135370.429775:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813258752 00000100:00100000:1.0:1783135370.429847:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1783135370.429858:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813258752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135370.429871:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135370.429885:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c951 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.429907:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c951 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.429917:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c951 expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.429926:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42156400, rc 0) 00000100:00100000:1.0:1783135370.429966:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813258752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.429972:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783135370.430674:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135370.430696:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792258816 00000100:00100000:3.0:1783135370.430700:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792258816 00000100:00100000:3.0:1783135370.430727:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 174 00000100:00100000:3.0:1783135370.430734:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5578:x1869752792258816:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135370.431012:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5578:x1869752792258816:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 Request processed in 278us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135370.431027:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 174 00000100:00100000:2.0:1783135370.431221:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813258752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135370.431238:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135370.431248:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135370.431309:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813258880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135370.431355:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135370.431380:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135370.432948:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813258880 00000100:00100000:3.0:1783135370.432960:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813258880 00000100:00100000:3.0:1783135370.432998:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1783135370.433008:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813258880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135370.433262:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813258880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135370.433269:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1783135370.435045:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813258880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135370.435106:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813259008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135370.435168:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135370.435206:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.435298:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813259008 00000100:00100000:1.0:1783135370.435305:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813259008 00000100:00100000:1.0:1783135370.435365:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1783135370.435374:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813259008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.435567:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813259008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.435575:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1783135370.435715:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813259008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135370.436073:0:8413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8413:1869752813259136:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135370.436113:0:8413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135370.436144:0:8413:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.436185:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813259136 00000100:00100000:1.0:1783135370.436190:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813259136 00000100:00100000:1.0:1783135370.436222:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783135370.436237:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:8413:x1869752813259136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135370.436386:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:8413:x1869752813259136:12345-0@lo:502:llog_process_th.0 Request processed in 149us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.436392:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1783135370.436532:0:8413:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8413:1869752813259136:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135370.436555:0:8413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135370.436567:0:8413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135370.436570:0:8413:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783135370.436577:0:8413:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8e0182b800 00000020:00000080:2.0:1783135370.436579:0:8413:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783135370.436658:0:8413:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8413:1869752813259264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135370.436691:0:8413:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135370.436717:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813259264 00000100:00100000:2.0:1783135370.436721:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813259264 00000100:00100000:2.0:1783135370.436742:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783135370.436749:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:8413:x1869752813259264:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135370.436895:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:8413:x1869752813259264:12345-0@lo:502:llog_process_th.0 Request processed in 145us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135370.436903:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783135370.436935:0:8413:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135370.436946:0:8413:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8413:1869752813259264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783135370.436968:0:8413:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135370.436972:0:8413:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135370.436973:0:8413:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783135370.436977:0:8413:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:0.0:1783135370.438193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135370.440596:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792258944 00000100:00100000:3.0:1783135370.440611:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792258944 00000100:00100000:3.0:1783135370.440677:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 179 00000100:00100000:3.0:1783135370.440687:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5578:x1869752792258944:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135370.440966:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:5578:x1869752792258944:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 Request processed in 278us (2776us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135370.440975:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 179 00000020:01000000:1.0:1783135370.441761:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783135370.441791:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135370.441804:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.441846:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135370.441856:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135370.441859:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f04f38800 from 4 10000000:01000000:1.0:1783135370.441862:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135370.441899:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.441907:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.441916:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135370.441940:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813259392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.441994:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135370.442031:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.442048:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813259392 00000100:00100000:1.0:1783135370.442053:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813259392 00000100:00100000:1.0:1783135370.442097:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783135370.442104:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813259392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135370.442114:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135370.442124:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c95f expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.442144:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c95f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.442156:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c95f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.442165:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f42157000, rc 0) 00000100:00100000:1.0:1783135370.442196:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813259392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.442203:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783135370.442252:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813259392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135370.442266:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.442275:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135370.442319:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813259520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.442343:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135370.442356:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.442365:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813259520 00000100:00100000:1.0:1783135370.442368:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813259520 00000100:00100000:1.0:1783135370.442393:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783135370.442399:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813259520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.442630:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813259520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.442636:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1783135370.442662:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813259520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.442686:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813259648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.442715:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135370.442726:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.442735:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813259648 00000100:00100000:1.0:1783135370.442739:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813259648 00000100:00100000:1.0:1783135370.442755:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783135370.442761:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813259648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.442913:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813259648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.442920:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783135370.442954:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813259648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.443160:0:8415:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8415:1869752813259776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135370.443190:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135370.443207:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813259776 00000100:00100000:1.0:1783135370.443210:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813259776 00000100:00100000:1.0:1783135370.443231:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1783135370.443238:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:8415:x1869752813259776:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135370.443346:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:8415:x1869752813259776:12345-0@lo:502:llog_process_th.0 Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.443360:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1783135370.443390:0:8415:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.443401:0:8415:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8415:1869752813259776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135370.443421:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135370.443430:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135370.443433:0:8415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783135370.443440:0:8415:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8f04f38800 00000020:00000080:1.0:1783135370.443442:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783135370.451668:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135370.456852:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792259072 00000100:00100000:1.0:1783135370.456869:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792259072 00000100:00100000:1.0:1783135370.456943:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 184 00000100:00100000:1.0:1783135370.456954:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:6116:x1869752792259072:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135370.457233:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:6116:x1869752792259072:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 280us (5576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.457241:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 184 00000100:00100000:1.0:1783135370.457978:0:8415:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8415:1869752813259904:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135370.458038:0:8415:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135370.458083:0:8415:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135370.458198:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813259904 00000100:00100000:2.0:1783135370.458204:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813259904 00000100:00100000:2.0:1783135370.458240:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1783135370.458249:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:8415:x1869752813259904:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135370.458426:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:8415:x1869752813259904:12345-0@lo:502:llog_process_th.0 Request processed in 177us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135370.458433:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1783135370.461765:0:8415:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8415:1869752813259904:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135370.461834:0:8415:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135370.461843:0:8415:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135370.461845:0:8415:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1783135370.461850:0:8415:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1783135370.461920:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1783135370.461938:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135370.461947:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.461965:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135370.461976:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135370.461979:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f063e9800 from 4 10000000:01000000:1.0:1783135370.461981:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135370.462012:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.462020:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.462029:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135370.462049:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813260032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.462114:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135370.462149:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.462166:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813260032 00000100:00100000:1.0:1783135370.462171:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813260032 00000100:00100000:1.0:1783135370.462219:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783135370.462228:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813260032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135370.462241:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135370.462254:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c96d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.462277:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c96d expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.462299:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c96d expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.462308:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f00030600, rc 0) 00000100:00100000:1.0:1783135370.462970:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813260032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.462982:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1783135370.463033:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813260032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135370.463048:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135370.463057:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135370.463107:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813260160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.463143:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135370.463171:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135370.463871:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813260160 00000100:00100000:3.0:1783135370.463881:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813260160 00000100:00100000:3.0:1783135370.463929:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1783135370.463939:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813260160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135370.464220:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813260160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135370.464228:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1783135370.465702:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813260160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.465760:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813260288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135370.465851:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135370.465886:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135370.465952:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813260288 00000100:00100000:3.0:1783135370.465959:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813260288 00000100:00100000:3.0:1783135370.466009:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1783135370.466025:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813260288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135370.466201:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813260288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135370.466209:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1783135370.466286:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813260288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135370.470619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135370.474757:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792259200 00000100:00100000:1.0:1783135370.474773:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792259200 00000100:00100000:1.0:1783135370.474854:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 189 00000100:00100000:1.0:1783135370.474865:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:6116:x1869752792259200:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135370.478938:0:8418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8418:1869752813260416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135370.482890:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:6116:x1869752792259200:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 8014us (12265us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.482905:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 189 00000100:00100000:0.0:1783135370.483149:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135370.483198:0:8418:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.483905:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813260416 00000100:00100000:1.0:1783135370.483918:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813260416 00000100:00100000:1.0:1783135370.483972:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1783135370.483981:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:8418:x1869752813260416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135370.484213:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:8418:x1869752813260416:12345-0@lo:502:llog_process_th.0 Request processed in 232us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.484220:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783135370.484321:0:8418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8418:1869752813260416:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135370.484376:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135370.484392:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135370.484394:0:8418:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783135370.484403:0:8418:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8f063e9800 00000020:00000080:0.0:1783135370.484406:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783135370.484501:0:8418:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8418:1869752813260544:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135370.484541:0:8418:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135370.484564:0:8418:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135370.485239:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813260544 00000100:00100000:1.0:1783135370.485246:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813260544 00000100:00100000:1.0:1783135370.485288:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1783135370.485297:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:8418:x1869752813260544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135370.485563:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:8418:x1869752813260544:12345-0@lo:502:llog_process_th.0 Request processed in 266us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135370.485571:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1783135370.487977:0:8418:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:8418:1869752813260544:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135370.488030:0:8418:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135370.488039:0:8418:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135370.488042:0:8418:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783135370.488047:0:8418:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783135370.488234:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783135370.488254:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135370.488266:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135370.488279:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135371.193973:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135372.218459:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135372.410397:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813260800:0@lo:400:kworker.0 00000100:00100000:3.0:1783135372.410430:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813260672:0@lo:400:kworker.0 00000100:00100000:1.0:1783135372.411834:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813260928:0@lo:400:kworker.0 00000100:00100000:3.0:1783135372.412085:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135372.412133:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813261184:0@lo:400:kworker.0 00000100:00100000:2.0:1783135372.412768:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135372.412791:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813261312:0@lo:400:kworker.0 00000100:00100000:2.0:1783135372.412828:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135372.412863:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813261056:0@lo:400:kworker.0 00000100:00100000:2.0:1783135372.412886:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135372.412921:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813260800 00000100:00100000:2.0:1783135372.412930:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813260800 00000100:00100000:2.0:1783135372.412981:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135372.412991:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813260800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135372.413047:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813260800:12345-0@lo:400:kworker.0 Request processed in 57us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135372.413054:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135372.413092:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813260800:0@lo:400:kworker.0 00000100:00100000:2.0:1783135372.413144:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813261312 00000100:00100000:2.0:1783135372.413147:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813261312 00000100:00100000:2.0:1783135372.413171:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813261056 00000100:00100000:2.0:1783135372.413172:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813261056 00000100:00100000:2.0:1783135372.413183:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135372.413187:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813261312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135372.413213:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813261312:12345-0@lo:400:kworker.0 Request processed in 26us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135372.413217:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135372.413223:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135372.413227:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813261056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135372.417407:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813260672 00000100:00100000:0.0:1783135372.417435:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813260672 00000100:00100000:0.0:1783135372.417517:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1783135372.417529:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813260672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135372.417622:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813260672:12345-0@lo:400:kworker.0 Request processed in 96us (5538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135372.417629:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00080000:0.0:1783135372.417664:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135372.417670:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135372.418542:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1783135372.423762:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bfad80 x1869752813261312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135372.423783:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813261312:0@lo:400:kworker.0 00000100:00100000:3.0:1783135372.424086:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813260672:0@lo:400:kworker.0 00000100:00100000:2.0:1783135372.426372:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813261056:12345-0@lo:400:kworker.0 Request processed in 13134us (13475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135372.426386:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135372.426450:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813261184 00000100:00100000:2.0:1783135372.426458:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813261184 00000100:00100000:2.0:1783135372.426517:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783135372.426526:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813261184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135372.426786:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813261184:12345-0@lo:400:kworker.0 Request processed in 189us (8176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135372.426796:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1783135372.426833:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135372.426894:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813261184:0@lo:400:kworker.0 00000100:00100000:1.0:1783135372.428887:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135372.429069:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813260928 00000100:00100000:2.0:1783135372.429079:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813260928 00000100:00100000:2.0:1783135372.429135:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783135372.429143:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813260928:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783135372.429242:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135372.429872:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813260928:12345-0@lo:400:kworker.0 Request processed in 728us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135372.429879:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1783135372.429930:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bfa680 x1869752813261056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135372.429951:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813261056:0@lo:400:kworker.0 00000100:00100000:1.0:1783135372.433882:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813260928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135372.925150:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135372.925180:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813261440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135372.925254:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135372.925358:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813261440 00000100:00100000:3.0:1783135372.925368:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813261440 00000100:00100000:3.0:1783135372.925430:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783135372.925440:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813261440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135372.925486:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135372.925537:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813261440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135372.925546:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1783135372.925601:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb4380 x1869752813261440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135372.925619:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813261440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783135373.242940:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135374.266970:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135374.842864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135374.845075:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135374.845133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135374.845164:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135374.845194:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792259584 00000100:00100000:0.0:1783135374.845203:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792259584 00000100:00100000:0.0:1783135374.845280:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792259712 00000100:00100000:0.0:1783135374.845284:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792259712 00000100:00100000:0.0:1783135374.845309:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:0.0:1783135374.845319:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792259584:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135374.845421:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792259584:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 104us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135374.845429:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:0.0:1783135374.845446:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:0.0:1783135374.845453:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792259712:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135374.845478:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792259712:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 26us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135374.845484:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00080000:0.0:1783135374.845500:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135374.845503:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135374.846097:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792259328 00000100:00100000:2.0:1783135374.846104:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792259328 00000100:00100000:2.0:1783135374.846146:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 193 00000100:00100000:2.0:1783135374.846154:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2362:x1869752792259328:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135374.846193:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2362:x1869752792259328:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 40us (3342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135374.846201:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 193 00000100:00100000:3.0:1783135374.848224:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792259456 00000100:00100000:3.0:1783135374.848237:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792259456 00000100:00100000:3.0:1783135374.848381:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00100000:3.0:1783135374.848392:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792259456:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135374.848475:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792259456:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 85us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135374.848483:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00080000:0.0:1783135374.848887:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135374.969964:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135374.969991:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813261568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135374.970069:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135374.970142:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813261568 00000100:00100000:2.0:1783135374.970151:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813261568 00000100:00100000:2.0:1783135374.970218:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783135374.970228:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813261568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135374.970265:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135374.970311:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813261568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135374.970317:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1783135374.970340:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783135374.970385:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bea00 x1869752813261568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135374.970403:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813261568:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783135375.290973:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135375.702500:0:8661:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1783135376.315956:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135377.337931:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135377.530349:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813262080:0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.530437:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135377.530509:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783135377.530516:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813261696:0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.530546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135377.530573:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813262208:0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.530597:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135377.530624:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813261824:0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.530648:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135377.530675:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813262336:0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.530696:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135377.530715:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135377.530721:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813261952:0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.530739:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135377.530784:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813261696 00000100:00100000:3.0:1783135377.530793:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813261696 00000100:00100000:3.0:1783135377.530864:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783135377.530873:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813261696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.530927:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813261696:12345-0@lo:400:kworker.0 Request processed in 55us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135377.530934:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1783135377.530967:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813262208 00000100:00100000:3.0:1783135377.530971:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813262208 00000100:00100000:3.0:1783135377.531000:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813261824 00000100:00100000:3.0:1783135377.531003:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813261824 00000100:00100000:3.0:1783135377.531570:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813261952 00000100:00100000:3.0:1783135377.531575:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813261952 00000100:00100000:3.0:1783135377.531594:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135377.531601:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813262208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.531644:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813262208:12345-0@lo:400:kworker.0 Request processed in 43us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135377.531650:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135377.531663:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135377.531669:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813261824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135377.531777:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813262080 00000100:00100000:0.0:1783135377.531783:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813262080 00000100:00100000:0.0:1783135377.531829:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813262336 00000100:00100000:0.0:1783135377.531832:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813262336 00000100:00100000:0.0:1783135377.531863:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783135377.531872:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813262080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135377.531909:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813262080:12345-0@lo:400:kworker.0 Request processed in 39us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135377.531928:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783135377.531942:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783135377.531948:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813262336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.532577:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813261824:12345-0@lo:400:kworker.0 Request processed in 905us (1925us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135377.532596:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135377.532614:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783135377.532621:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813261952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135377.533164:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813262336:12345-0@lo:400:kworker.0 Request processed in 1214us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135377.533171:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783135377.534171:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813261824:0@lo:400:kworker.0 00010000:00080000:1.0:1783135377.534190:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10530700 x1869752813262336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135377.534200:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813262336:0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.534440:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813261952:12345-0@lo:400:kworker.0 Request processed in 1819us (3697us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135377.534450:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1783135377.534480:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135377.534485:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135377.534487:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135377.534512:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813261696:0@lo:400:kworker.0 00000100:00100000:3.0:1783135377.534527:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813262208:0@lo:400:kworker.0 00010000:00080000:3.0:1783135377.534539:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bf8a80 x1869752813262080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135377.534548:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813262080:0@lo:400:kworker.0 00000100:00100000:1.0:1783135377.534623:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813261952:0@lo:400:kworker.0 00000100:00100000:3.0:1783135378.043856:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813262464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135378.043951:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135378.044086:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813262464 00000100:00100000:2.0:1783135378.044117:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813262464 00000100:00100000:2.0:1783135378.044183:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783135378.044191:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813262464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135378.044230:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135378.050743:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813262464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6539us (6780us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135378.050759:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1783135378.051131:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb4000 x1869752813262464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135378.051158:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813262464:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783135378.373127:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135379.385999:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135379.963371:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135379.963413:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135379.963439:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792260096 00000100:00100000:0.0:1783135379.963448:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792260096 00000100:00100000:0.0:1783135379.963505:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792260224 00000100:00100000:0.0:1783135379.963509:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792260224 00000100:00100000:0.0:1783135379.963532:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:0.0:1783135379.963542:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2359:x1869752792260096:12345-192.168.201.60@tcp:9:kworker.0 00000020:00000080:0.0:1783135379.963582:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c8b0 00000100:00080000:0.0:1783135379.963591:0:6587:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf6f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135379.963648:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783135379.964009:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+2:2359:x1869752792260096:12345-192.168.201.60@tcp:9:kworker.0 Request processed in 467us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135379.964017:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:0.0:1783135379.964035:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:0.0:1783135379.964042:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2359:x1869752792260224:12345-192.168.201.60@tcp:9:kworker.0 00000020:00000080:0.0:1783135379.964057:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c8b7 00000100:00080000:0.0:1783135379.964063:0:6587:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf69800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135379.964091:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783135379.964269:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+2:2359:x1869752792260224:12345-192.168.201.60@tcp:9:kworker.0 Request processed in 227us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135379.964302:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00080000:0.0:1783135379.964322:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135379.964326:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783135379.964385:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135379.964483:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135379.968630:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135379.968703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135379.968742:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792259968 00000100:00100000:3.0:1783135379.968757:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792259968 00000100:00100000:3.0:1783135379.968834:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:3.0:1783135379.968844:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792259968:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135379.968910:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792259968:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135379.968917:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:0.0:1783135379.969011:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792259840 00000100:00100000:0.0:1783135379.969016:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792259840 00000100:00100000:0.0:1783135379.969048:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 195 00000100:00100000:0.0:1783135379.969055:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2360:x1869752792259840:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135379.969084:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2360:x1869752792259840:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135379.969090:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 195 00000100:00080000:0.0:1783135379.969121:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135380.090361:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813262592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135380.090444:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135380.090575:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813262592 00000100:00100000:0.0:1783135380.090583:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813262592 00000100:00100000:0.0:1783135380.090644:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135380.090653:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813262592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135380.090690:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135380.090735:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813262592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135380.090742:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1783135380.090802:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135380.090844:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10530a80 x1869752813262592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135380.090863:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813262592:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783135380.412853:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783135381.166370:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:0.0:1783135381.166381:0:6616:0:(genops.c:906:class_export_put()) final put ffff8e8f3bf6d800/0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:2.0:1783135381.166673:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3bf6d800/0c7819a6-778a-4617-af33-00460db74182 for lustre-OST0000 00000020:00000080:2.0:1783135381.166736:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3bf6f800 for lustre-OST0000 00010000:00010000:1.0:1783135381.448360:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135382.005149:0:8907:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing yml_node 00010000:00010000:3.0:1783135382.466669:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135382.654042:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813262720:0@lo:400:kworker.0 00000100:00100000:2.0:1783135382.654129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135382.654432:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813263104:0@lo:400:kworker.0 00000100:00100000:1.0:1783135382.654467:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135382.654506:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813262848:0@lo:400:kworker.0 00000100:00100000:1.0:1783135382.654533:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135382.654550:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135382.654555:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813262976:0@lo:400:kworker.0 00000100:00100000:1.0:1783135382.654589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135382.654619:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813263104 00000100:00100000:1.0:1783135382.654626:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813263104 00000100:00100000:1.0:1783135382.654687:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135382.654696:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813263104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135382.654761:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813263104:12345-0@lo:400:kworker.0 Request processed in 66us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135382.654768:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1783135382.654787:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135382.654838:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10532d80 x1869752813263104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135382.654853:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813263104:0@lo:400:kworker.0 00000100:00100000:2.0:1783135382.655050:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813262720 00000100:00100000:2.0:1783135382.655055:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813262720 00000100:00100000:2.0:1783135382.655092:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783135382.655100:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813262720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135382.655140:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813262720:12345-0@lo:400:kworker.0 Request processed in 41us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135382.655146:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783135382.655179:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813262720:0@lo:400:kworker.0 00000100:00100000:2.0:1783135382.655354:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813263232:0@lo:400:kworker.0 00000100:00100000:2.0:1783135382.655383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135382.655435:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813262848 00000100:00100000:1.0:1783135382.655439:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813262848 00000100:00100000:1.0:1783135382.655458:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813262976 00000100:00100000:1.0:1783135382.655461:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813262976 00000100:00100000:1.0:1783135382.655475:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813263232 00000100:00100000:1.0:1783135382.655477:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813263232 00000100:00100000:1.0:1783135382.655490:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135382.655495:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813262848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135382.655528:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813262848:12345-0@lo:400:kworker.0 Request processed in 33us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135382.655533:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135382.655545:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135382.655550:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813262976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135382.655571:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813262976:12345-0@lo:400:kworker.0 Request processed in 22us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135382.655589:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783135382.655600:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783135382.655606:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813263232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135382.655693:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135382.655704:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813263360:0@lo:400:kworker.0 00000100:00100000:3.0:1783135382.655736:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135382.655771:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813263360 00000100:00100000:3.0:1783135382.655774:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813263360 00000100:00100000:3.0:1783135382.655802:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135382.655807:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813263360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135382.655857:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813263360:12345-0@lo:400:kworker.0 Request processed in 49us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135382.655863:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1783135382.655892:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10532680 x1869752813263360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135382.655901:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813263360:0@lo:400:kworker.0 00000100:00100000:0.0:1783135382.656464:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813262976:0@lo:400:kworker.0 00000100:00100000:0.0:1783135382.656477:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813262848:0@lo:400:kworker.0 00000100:00080000:0.0:1783135382.656503:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135382.656507:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135382.656965:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813263232:12345-0@lo:400:kworker.0 Request processed in 1357us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135382.656975:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135382.657084:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813263232:0@lo:400:kworker.0 00000100:00100000:3.0:1783135383.162048:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813263488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135383.162125:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135383.170788:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813263488 00000100:00100000:1.0:1783135383.170804:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813263488 00000100:00100000:1.0:1783135383.171125:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783135383.171136:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813263488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135383.171177:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135383.171310:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813263488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 175us (9184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135383.171317:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1783135383.172949:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb5180 x1869752813263488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135383.172975:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813263488:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783135383.481977:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135384.509594:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783135384.761658:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:2.0:1783135384.761668:0:7494:0:(genops.c:906:class_export_put()) final put ffff8e8f3bf6e800/0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:1.0:1783135384.761760:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3bf6e800/0c7819a6-778a-4617-af33-00460db74182 for lustre-OST0001 00000020:00000080:1.0:1783135384.761860:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3bf69800 for lustre-OST0001 00000100:00100000:0.0:1783135385.086356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135385.086416:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135385.086573:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792260352 00000100:00100000:3.0:1783135385.086586:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792260352 00000100:00100000:3.0:1783135385.086651:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 197 00000100:00100000:3.0:1783135385.086675:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2362:x1869752792260352:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135385.087015:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792260480 00000100:00100000:1.0:1783135385.087020:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792260480 00000100:00100000:1.0:1783135385.087066:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:1.0:1783135385.087074:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792260480:12345-192.168.201.60@tcp:400:kworker.0 00000100:00080000:2.0:1783135385.087101:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135385.087158:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2362:x1869752792260352:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 496us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135385.087166:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 197 00000100:00100000:1.0:1783135385.093712:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792260480:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 6622us (7279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135385.093728:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:1.0:1783135385.210393:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813263616:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135385.210489:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135385.210810:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813263616 00000100:00100000:0.0:1783135385.210843:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813263616 00000100:00100000:0.0:1783135385.210919:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783135385.210930:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813263616:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783135385.210934:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1783135385.210967:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135385.211031:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813263616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135385.211039:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1783135385.211071:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10531180 x1869752813263616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135385.211090:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813263616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783135385.529982:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135386.556748:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135386.676179:0:9099:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.84 00010000:00010000:0.0:1783135387.577993:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135387.771424:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813263872:0@lo:400:kworker.0 00000100:00100000:2.0:1783135387.771512:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135387.771566:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813264384:0@lo:400:kworker.0 00000100:00100000:2.0:1783135387.771594:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135387.771638:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135387.771645:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813264000:0@lo:400:kworker.0 00000100:00100000:2.0:1783135387.771668:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135387.771699:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813263872 00000100:00100000:2.0:1783135387.771706:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813263872 00000100:00100000:2.0:1783135387.771748:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813264000 00000100:00100000:2.0:1783135387.771751:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813264000 00000100:00100000:2.0:1783135387.771776:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135387.771786:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813263872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135387.771877:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813263872:12345-0@lo:400:kworker.0 Request processed in 91us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135387.771884:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783135387.771902:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783135387.771909:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813264000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135387.771936:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813264000:12345-0@lo:400:kworker.0 Request processed in 28us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135387.771942:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783135387.771974:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813264384 00000100:00100000:2.0:1783135387.771978:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813264384 00000100:00100000:2.0:1783135387.772005:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135387.772012:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813264384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135387.772042:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813264384:12345-0@lo:400:kworker.0 Request processed in 31us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135387.772048:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1783135387.772070:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135387.772075:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135387.772104:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813264000:0@lo:400:kworker.0 00000100:00100000:2.0:1783135387.772114:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813263872:0@lo:400:kworker.0 00010000:00080000:2.0:1783135387.772125:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f05730700 x1869752813264384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135387.772136:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813264384:0@lo:400:kworker.0 00000100:00100000:3.0:1783135387.772373:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813263744:0@lo:400:kworker.0 00000100:00100000:3.0:1783135387.772413:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135387.772457:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813264256:0@lo:400:kworker.0 00000100:00100000:3.0:1783135387.772479:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135387.772497:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135387.772503:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813264128:0@lo:400:kworker.0 00000100:00100000:3.0:1783135387.772524:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135387.772586:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813264128 00000100:00100000:3.0:1783135387.772590:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813264128 00000100:00100000:3.0:1783135387.772624:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135387.772630:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813264128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135387.772666:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813264128:12345-0@lo:400:kworker.0 Request processed in 36us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135387.772672:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135387.776329:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813263744 00000100:00100000:2.0:1783135387.776346:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813263744 00000100:00100000:2.0:1783135387.776419:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1783135387.776429:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813263744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135387.776531:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813263744:12345-0@lo:400:kworker.0 Request processed in 103us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135387.776538:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1783135387.777890:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135387.777910:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813264256 00000100:00100000:0.0:1783135387.777918:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813264256 00000100:00100000:0.0:1783135387.777972:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135387.777980:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813264256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135387.778041:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813264256:12345-0@lo:400:kworker.0 Request processed in 61us (5560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135387.778047:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1783135387.778065:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783135387.779669:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bca80 x1869752813264128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135387.779705:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813264128:0@lo:400:kworker.0 00000100:00100000:3.0:1783135387.779720:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813263744:0@lo:400:kworker.0 00000100:00100000:3.0:1783135387.779733:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813264256:0@lo:400:kworker.0 00000100:00100000:3.0:1783135388.282836:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813264512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135388.282910:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135388.283036:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813264512 00000100:00100000:0.0:1783135388.283044:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813264512 00000100:00100000:0.0:1783135388.283088:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783135388.283097:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813264512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135388.283131:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135388.283222:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813264512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135388.283230:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1783135388.283631:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb7480 x1869752813264512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135388.283651:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813264512:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783135388.601947:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135389.348812:0:9197:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.84 00010000:00010000:1.0:1783135389.629754:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135390.199875:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135390.199924:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135390.199961:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792260608 00000100:00100000:0.0:1783135390.199971:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792260608 00000100:00100000:0.0:1783135390.200036:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 199 00000100:00100000:0.0:1783135390.200047:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792260608:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135390.200130:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792260608:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 84us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135390.200138:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 199 00000100:00100000:2.0:1783135390.200603:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792260736 00000100:00100000:2.0:1783135390.200608:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792260736 00000100:00100000:2.0:1783135390.200731:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:2.0:1783135390.200740:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792260736:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135390.200795:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10533100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792260736:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 56us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135390.200803:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00080000:0.0:1783135390.201284:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135390.335011:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813264640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135390.335091:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135390.335141:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813264640 00000100:00100000:0.0:1783135390.335149:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813264640 00000100:00100000:0.0:1783135390.335210:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783135390.335219:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813264640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135390.335255:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135390.335314:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813264640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135390.335320:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1783135390.335336:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10532300 x1869752813264640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1783135390.335339:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135390.335354:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813264640:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135390.650062:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135391.674670:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135392.005546:0:9294:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.84 00010000:00010000:1.0:1783135392.699146:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135392.890134:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813265024:0@lo:400:kworker.0 00000100:00100000:2.0:1783135392.890229:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135392.890294:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783135392.890299:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813264896:0@lo:400:kworker.0 00000100:00100000:2.0:1783135392.890331:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135392.890346:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813265408:0@lo:400:kworker.0 00000100:00100000:2.0:1783135392.890367:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135392.890397:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813265024 00000100:00100000:2.0:1783135392.890403:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813265024 00000100:00100000:2.0:1783135392.890444:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813264896 00000100:00100000:2.0:1783135392.890447:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813264896 00000100:00100000:0.0:1783135392.890844:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813265152:0@lo:400:kworker.0 00000100:00100000:0.0:1783135392.890875:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135392.890897:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783135392.890910:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813264768:0@lo:400:kworker.0 00000100:00100000:0.0:1783135392.890936:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135392.891120:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135392.891134:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813265024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135392.891192:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813265024:12345-0@lo:400:kworker.0 Request processed in 63us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135392.891200:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135392.891218:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1783135392.891225:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813264896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135392.891263:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813264896:12345-0@lo:400:kworker.0 Request processed in 39us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135392.891268:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783135392.899094:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813265280:0@lo:400:kworker.0 00000100:00100000:0.0:1783135392.899388:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783135392.899455:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135392.899549:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813265408 00000100:00100000:0.0:1783135392.899557:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813265408 00000100:00100000:0.0:1783135392.899614:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813265152 00000100:00100000:0.0:1783135392.899617:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813265152 00000100:00100000:0.0:1783135392.899641:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135392.899650:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813265408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135392.899708:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813265408:12345-0@lo:400:kworker.0 Request processed in 59us (9339us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135392.899715:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135392.899865:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813265280 00000100:00100000:3.0:1783135392.899869:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813265280 00000100:00100000:3.0:1783135392.899896:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783135392.899903:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813265280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135392.899941:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813265280:12345-0@lo:400:kworker.0 Request processed in 38us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135392.899947:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1783135392.900096:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783135392.900104:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813265152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135392.900134:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813265152:12345-0@lo:400:kworker.0 Request processed in 32us (9258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135392.900140:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783135392.900213:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813264896:0@lo:400:kworker.0 00010000:00080000:3.0:1783135392.900229:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bce00 x1869752813265408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135392.900239:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813265408:0@lo:400:kworker.0 00000100:00100000:3.0:1783135392.900251:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813265024:0@lo:400:kworker.0 00000100:00080000:3.0:1783135392.900300:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135392.900303:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135392.900305:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135392.900323:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813265280:0@lo:400:kworker.0 00010000:00080000:3.0:1783135392.900333:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bca80 x1869752813265152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135392.900341:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813265152:0@lo:400:kworker.0 00000100:00100000:1.0:1783135392.909447:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813264768 00000100:00100000:1.0:1783135392.909465:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813264768 00000100:00100000:1.0:1783135392.909532:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783135392.909543:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813264768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135392.909646:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813264768:12345-0@lo:400:kworker.0 Request processed in 105us (18708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135392.909653:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1783135392.911492:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813264768:0@lo:400:kworker.0 00000100:00100000:1.0:1783135393.404393:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135393.404422:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813265536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135393.404511:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135393.411757:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813265536 00000100:00100000:3.0:1783135393.411775:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813265536 00000100:00100000:3.0:1783135393.411854:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135393.412396:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813265536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135393.412443:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135393.412535:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813265536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 672us (8025us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135393.412556:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1783135393.412638:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb4e00 x1869752813265536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135393.412670:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813265536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783135393.732123:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135393.774573:0:9342:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 3 23:23:11 EDT 2026 00010000:00010000:3.0:1783135394.747316:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135395.318095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135395.318142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135395.318227:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792260864 00000100:00100000:2.0:1783135395.318238:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792260864 00000100:00100000:2.0:1783135395.318295:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 201 00000100:00100000:2.0:1783135395.318305:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792260864:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135395.318392:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792260864:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135395.318399:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 201 00000100:00100000:3.0:1783135395.318854:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792260992 00000100:00100000:3.0:1783135395.318860:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792260992 00000100:00100000:3.0:1783135395.318907:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 53 00000100:00100000:3.0:1783135395.318915:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792260992:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135395.318968:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792260992:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 53us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135395.318974:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 53 00000100:00080000:0.0:1783135395.319080:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135395.450188:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813265664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135395.450264:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135395.450470:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813265664 00000100:00100000:2.0:1783135395.450478:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813265664 00000100:00100000:2.0:1783135395.450541:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135395.450560:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813265664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135395.450599:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783135395.450669:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135395.457435:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813265664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6864us (7158us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135395.457451:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1783135395.459427:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37c2ad80 x1869752813265664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135395.459459:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813265664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135395.771961:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135396.794905:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135397.820354:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135398.010191:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813265920:0@lo:400:kworker.0 00000100:00100000:2.0:1783135398.010280:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.010425:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813265792:0@lo:400:kworker.0 00000100:00100000:0.0:1783135398.010461:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135398.010504:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813265792 00000100:00100000:0.0:1783135398.010512:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813265792 00000100:00100000:0.0:1783135398.010555:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783135398.010565:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813265792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135398.010615:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813265792:12345-0@lo:400:kworker.0 Request processed in 51us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.010622:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783135398.010714:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813265792:0@lo:400:kworker.0 00000100:00100000:0.0:1783135398.010755:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813265920 00000100:00100000:0.0:1783135398.010759:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813265920 00000100:00100000:0.0:1783135398.010789:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783135398.010796:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813265920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135398.011056:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813266048:0@lo:400:kworker.0 00000100:00100000:1.0:1783135398.011086:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.011117:0:5794:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783135398.011126:0:5794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1783135398.011239:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813266048 00000100:00100000:1.0:1783135398.011243:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813266048 00000100:00100000:1.0:1783135398.011271:0:5794:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1783135398.011280:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135398.011285:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813266048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135398.011332:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813266048:12345-0@lo:400:kworker.0 Request processed in 46us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.011338:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135398.011368:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813266048:0@lo:400:kworker.0 00000100:00080000:1.0:1783135398.011514:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135398.012402:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813266176:0@lo:400:kworker.0 00000100:00100000:3.0:1783135398.012428:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135398.012455:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813266432:0@lo:400:kworker.0 00000100:00100000:1.0:1783135398.012458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.012489:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135398.012497:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813266304:0@lo:400:kworker.0 00000100:00100000:3.0:1783135398.012502:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.012536:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813266176 00000100:00100000:3.0:1783135398.012543:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813266176 00000100:00100000:1.0:1783135398.012547:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135398.012583:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813266304 00000100:00100000:1.0:1783135398.012586:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813266304 00000100:00100000:3.0:1783135398.012608:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813266432 00000100:00100000:3.0:1783135398.012613:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813266432 00000100:00100000:1.0:1783135398.012621:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783135398.012632:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813266304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135398.012648:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135398.012671:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813266176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135398.012715:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813266176:12345-0@lo:400:kworker.0 Request processed in 60us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.012723:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135398.012738:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135398.012743:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813266432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135398.012776:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813266432:12345-0@lo:400:kworker.0 Request processed in 32us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135398.012791:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135398.012799:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813266304:12345-0@lo:400:kworker.0 Request processed in 168us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135398.012807:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1783135398.012856:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bca80 x1869752813266432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135398.012870:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813266432:0@lo:400:kworker.0 00000100:00080000:3.0:1783135398.012888:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135398.012892:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135398.012894:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135398.012912:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813266304:0@lo:400:kworker.0 00010000:00080000:3.0:1783135398.012926:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37c2ad80 x1869752813266176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135398.012935:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813266176:0@lo:400:kworker.0 00000100:00100000:0.0:1783135398.013202:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813265920:12345-0@lo:400:kworker.0 Request processed in 2404us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135398.013211:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135398.014423:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813265920:0@lo:400:kworker.0 00000100:00100000:2.0:1783135398.522088:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135398.522116:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813266560:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135398.522188:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135398.522236:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813266560 00000100:00100000:3.0:1783135398.522246:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813266560 00000100:00100000:3.0:1783135398.522305:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783135398.522315:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813266560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135398.522362:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135398.522414:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813266560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (226us total) trans 0 rc 0/0 00010000:00080000:2.0:1783135398.522451:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb6a00 x1869752813266560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135398.522470:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813266560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135398.522489:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1783135398.849405:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135399.866041:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135400.441583:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135400.441710:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792261248 00000100:00100000:1.0:1783135400.441720:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792261248 00000100:00100000:1.0:1783135400.441807:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:1.0:1783135400.441843:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792261248:12345-192.168.201.60@tcp:400:kworker.0 00000100:00080000:2.0:1783135400.442004:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135400.443980:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10533800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792261248:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 2153us (2400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135400.443995:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:2.0:1783135400.444280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135400.444363:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792261120 00000100:00100000:1.0:1783135400.444373:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792261120 00000100:00100000:1.0:1783135400.444511:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 203 00000100:00100000:1.0:1783135400.444521:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2363:x1869752792261120:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135400.444600:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2363:x1869752792261120:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 81us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135400.444607:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 203 00000100:00100000:1.0:1783135400.578189:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813266688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135400.578273:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135400.578442:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813266688 00000100:00100000:3.0:1783135400.578463:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813266688 00000100:00100000:3.0:1783135400.578527:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783135400.578537:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813266688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135400.578574:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135400.578631:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813266688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135400.578652:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1783135400.578868:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135400.578900:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bca80 x1869752813266688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135400.578938:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813266688:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783135400.901103:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135401.913975:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135402.938291:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135403.131035:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813266944:0@lo:400:kworker.0 00000100:00100000:3.0:1783135403.131098:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.131145:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813267456:0@lo:400:kworker.0 00000100:00100000:3.0:1783135403.131169:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.131197:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135403.131202:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813267072:0@lo:400:kworker.0 00000100:00100000:3.0:1783135403.131236:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.131271:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813267456 00000100:00100000:3.0:1783135403.131277:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813267456 00000100:00100000:0.0:1783135403.131288:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813267200:0@lo:400:kworker.0 00000100:00100000:0.0:1783135403.131316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135403.131326:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813267200 00000100:00100000:3.0:1783135403.131329:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813267200 00000100:00100000:0.0:1783135403.131336:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783135403.131341:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813266816:0@lo:400:kworker.0 00000100:00100000:0.0:1783135403.131369:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.131388:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813267328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135403.131408:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135403.131432:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813266944 00000100:00100000:0.0:1783135403.131435:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813266944 00000100:00100000:0.0:1783135403.131462:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813267072 00000100:00100000:0.0:1783135403.131465:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813267072 00000100:00100000:0.0:1783135403.131477:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813267328 00000100:00100000:0.0:1783135403.131479:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813267328 00000100:00100000:3.0:1783135403.131494:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135403.131494:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783135403.131502:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813267456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135403.131502:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813266944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135403.131549:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813266944:12345-0@lo:400:kworker.0 Request processed in 47us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.131566:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783135403.131582:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783135403.131588:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813267072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135403.131593:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783135403.131614:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813267328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135403.131650:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813267328:12345-0@lo:400:kworker.0 Request processed in 50us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.131656:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783135403.134912:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813266816 00000100:00100000:1.0:1783135403.134924:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813266816 00000100:00100000:1.0:1783135403.134993:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783135403.135002:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813266816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135403.135083:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813266816:12345-0@lo:400:kworker.0 Request processed in 82us (3712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.135091:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1783135403.135129:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135403.135137:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813267200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135403.135171:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813267200:12345-0@lo:400:kworker.0 Request processed in 35us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135403.135178:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783135403.135830:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813267456:12345-0@lo:400:kworker.0 Request processed in 4313us (4645us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135403.135839:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1783135403.135861:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135403.135866:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135403.135868:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135403.143236:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813267072:12345-0@lo:400:kworker.0 Request processed in 11637us (11988us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135403.143252:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783135403.143332:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813266816:0@lo:400:kworker.0 00000100:00100000:0.0:1783135403.143349:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813267328:0@lo:400:kworker.0 00010000:00080000:0.0:1783135403.143365:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bca80 x1869752813267200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135403.143375:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813267200:0@lo:400:kworker.0 00000100:00100000:1.0:1783135403.143554:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813267072:0@lo:400:kworker.0 00000100:00100000:1.0:1783135403.143568:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813266944:0@lo:400:kworker.0 00010000:00080000:1.0:1783135403.143580:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37c2ad80 x1869752813267456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135403.143589:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813267456:0@lo:400:kworker.0 00000100:00100000:3.0:1783135403.643476:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813267584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135403.643552:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135403.643671:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813267584 00000100:00100000:2.0:1783135403.643679:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813267584 00000100:00100000:2.0:1783135403.643738:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135403.643748:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813267584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135403.643785:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135403.650688:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813267584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6932us (7126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135403.650717:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1783135403.650929:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10531180 x1869752813267584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135403.650968:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813267584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783135403.962963:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135404.989640:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135405.558547:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135405.558706:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792261376 00000100:00100000:1.0:1783135405.558722:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792261376 00000100:00100000:1.0:1783135405.558791:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 205 00000100:00100000:1.0:1783135405.558802:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2360:x1869752792261376:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135405.558935:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2360:x1869752792261376:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 134us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135405.558945:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 205 00000100:00100000:3.0:1783135405.563894:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135405.564092:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792261504 00000100:00100000:1.0:1783135405.564101:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792261504 00000100:00100000:1.0:1783135405.564175:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:1.0:1783135405.564186:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792261504:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135405.564261:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792261504:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 78us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135405.564269:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00080000:3.0:1783135405.564626:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135405.690341:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135405.692912:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813267712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135405.693003:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135405.694783:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813267712 00000100:00100000:0.0:1783135405.694797:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813267712 00000100:00100000:0.0:1783135405.694894:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135405.694907:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813267712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135405.694948:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135405.695036:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813267712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135405.695043:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1783135405.695101:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3fcb7480 x1869752813267712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135405.695778:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135405.696067:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813267712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783135406.010471:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135407.034943:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135408.058044:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135408.252854:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813268096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135408.253325:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813267840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135408.253436:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135408.253495:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813268352:0@lo:400:kworker.0 00000100:00100000:2.0:1783135408.253525:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135408.253570:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813268224:0@lo:400:kworker.0 00000100:00100000:1.0:1783135408.253650:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135408.253725:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813267968:0@lo:400:kworker.0 00000100:00100000:0.0:1783135408.253753:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813267840 00000100:00100000:0.0:1783135408.253766:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813267840 00000100:00100000:1.0:1783135408.253776:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135408.253861:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813268480:0@lo:400:kworker.0 00000100:00100000:1.0:1783135408.253896:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135408.253943:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813268352 00000100:00100000:1.0:1783135408.253950:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813268352 00000100:00100000:0.0:1783135408.254005:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783135408.254018:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813267840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135408.254080:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813267840:12345-0@lo:400:kworker.0 Request processed in 66us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135408.254087:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1783135408.254489:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813267968 00000100:00100000:1.0:1783135408.254495:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813267968 00000100:00100000:1.0:1783135408.254522:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135408.254531:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813268352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135408.254613:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813268352:12345-0@lo:400:kworker.0 Request processed in 83us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135408.254622:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135408.254641:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783135408.254648:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813267968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135408.254679:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813267968:12345-0@lo:400:kworker.0 Request processed in 32us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135408.254685:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1783135408.254730:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135408.254782:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813267968:0@lo:400:kworker.0 00000100:00100000:1.0:1783135408.254887:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813268224 00000100:00100000:1.0:1783135408.254892:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813268224 00000100:00100000:1.0:1783135408.254931:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813268480 00000100:00100000:1.0:1783135408.254934:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813268480 00000100:00100000:1.0:1783135408.254958:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135408.254963:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813268224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135408.255554:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135408.255661:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135408.255672:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813268480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135408.255719:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813268480:12345-0@lo:400:kworker.0 Request processed in 51us (1822us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135408.255727:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1783135408.255750:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135408.255754:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135408.255785:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10533b80 x1869752813268480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135408.255811:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813268480:0@lo:400:kworker.0 00000100:00100000:3.0:1783135408.255854:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813268096 00000100:00100000:3.0:1783135408.255857:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813268096 00000100:00100000:3.0:1783135408.255894:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783135408.255899:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813268096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135408.255930:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813268096:12345-0@lo:400:kworker.0 Request processed in 32us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135408.255937:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783135408.256555:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813267840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135408.256583:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813268352:0@lo:400:kworker.0 00000100:00080000:2.0:1783135408.256667:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135408.259730:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813268096:0@lo:400:kworker.0 00000100:00100000:1.0:1783135408.265613:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813268224:12345-0@lo:400:kworker.0 Request processed in 10627us (11941us total) trans 0 rc 0/0 00010000:00080000:0.0:1783135408.265667:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10532d80 x1869752813268224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135408.265687:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813268224:0@lo:400:kworker.0 00000100:00100000:1.0:1783135408.266261:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1783135408.763299:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813268608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135408.763393:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135408.763631:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813268608 00000100:00100000:2.0:1783135408.763639:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813268608 00000100:00100000:2.0:1783135408.763702:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783135408.763711:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813268608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135408.763748:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135408.763806:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813268608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135408.763813:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1783135408.763873:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bf9f80 x1869752813268608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135408.763898:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813268608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783135409.085049:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135409.476401:0:9973:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:23:27 (1783135407) === 00000100:00100000:3.0:1783135409.972632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135409.973005:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792261632 00000100:00100000:0.0:1783135409.973015:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792261632 00000100:00100000:0.0:1783135409.973125:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 207 00000100:00100000:0.0:1783135409.973145:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:8114:x1869752792261632:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135409.973165:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135409.973185:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05220c00/0xf646e0cda875c97b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d3d expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135409.973217:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05220c00/0xf646e0cda875c97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d3d expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135409.973229:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05220c00/0xf646e0cda875c97b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d3d expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135409.973238:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05220c00, rc 0) 00000100:00100000:0.0:1783135409.973321:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8114:x1869752792261632:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 187us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135409.973345:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 207 00000100:00100000:1.0:1783135409.984995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135409.985120:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792261760 00000100:00100000:0.0:1783135409.985131:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792261760 00000100:00100000:0.0:1783135409.985224:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 208 00000100:00100000:0.0:1783135409.985235:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8114:x1869752792261760:12345-192.168.201.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783135409.985585:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8114:x1869752792261760:12345-192.168.201.60@tcp:501:mount.lustre.0 Request processed in 350us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135409.985593:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 208 00000100:00100000:3.0:1783135409.988674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135409.989544:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792261888 00000100:00100000:0.0:1783135409.989560:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792261888 00000100:00100000:0.0:1783135409.989655:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 209 00000100:00100000:0.0:1783135409.989668:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8114:x1869752792261888:12345-192.168.201.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783135409.990593:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8114:x1869752792261888:12345-192.168.201.60@tcp:503:mount.lustre.0 Request processed in 924us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135409.990605:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 209 00000100:00100000:3.0:1783135409.995561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135409.995636:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792262016 00000100:00100000:0.0:1783135409.995648:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792262016 00000100:00100000:0.0:1783135409.995728:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 210 00000100:00100000:0.0:1783135409.995740:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8118:x1869752792262016:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135409.996347:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8118:x1869752792262016:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 534us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135409.996356:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 210 00000100:00100000:1.0:1783135410.022642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135410.022858:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792262144 00000100:00100000:0.0:1783135410.023371:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792262144 00000100:00100000:0.0:1783135410.023523:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 211 00000100:00100000:0.0:1783135410.023535:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8118:x1869752792262144:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135410.023858:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8118:x1869752792262144:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 324us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135410.023877:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 211 00000100:00100000:3.0:1783135410.045452:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135410.046054:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792262272 00000100:00100000:0.0:1783135410.046074:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792262272 00000100:00100000:0.0:1783135410.046437:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 212 00000100:00100000:0.0:1783135410.046450:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:8114:x1869752792262272:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135410.046481:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135410.046502:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05220e00/0xf646e0cda875c982 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d67 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135410.046530:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05220e00/0xf646e0cda875c982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d67 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135410.046542:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05220e00/0xf646e0cda875c982 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d67 expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135410.046552:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05220e00, rc 0) 00000100:00100000:0.0:1783135410.046630:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:8114:x1869752792262272:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 183us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135410.046637:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 212 00000100:00100000:3.0:1783135410.068003:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135410.068110:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792262400 00000100:00100000:0.0:1783135410.068129:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792262400 00000100:00100000:0.0:1783135410.068283:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 213 00000100:00100000:0.0:1783135410.068295:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:8114:x1869752792262400:12345-192.168.201.60@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783135410.068349:0:5788:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783135410.068370:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783135410.068375:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783135410.068379:0:5788:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783135410.068381:0:5788:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1783135410.078686:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:8114:x1869752792262400:12345-192.168.201.60@tcp:256:mount.lustre.0 Request processed in 10380us (10693us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135410.078704:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 213 00000100:00100000:3.0:1783135410.084119:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135410.084492:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792262528 00000100:00100000:0.0:1783135410.084505:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792262528 00000100:00100000:0.0:1783135410.084577:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 214 00000100:00100000:0.0:1783135410.084589:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:8114:x1869752792262528:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135410.084615:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135410.084637:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d6e expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135410.084671:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135410.084681:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135410.084691:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05221400, rc 0) 00000100:00100000:0.0:1783135410.085094:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8114:x1869752792262528:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 506us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135410.085102:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 214 00000100:00100000:2.0:1783135410.088910:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135410.089212:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792262656 00000100:00100000:0.0:1783135410.089241:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792262656 00000100:00100000:0.0:1783135410.089310:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 215 00000100:00100000:0.0:1783135410.089319:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8114:x1869752792262656:12345-192.168.201.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783135410.090167:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8114:x1869752792262656:12345-192.168.201.60@tcp:501:mount.lustre.0 Request processed in 843us (1263us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135410.090178:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 215 00000100:00100000:1.0:1783135410.092745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135410.093166:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792262784 00000100:00100000:0.0:1783135410.093177:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792262784 00000100:00100000:0.0:1783135410.093237:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 216 00000100:00100000:0.0:1783135410.093249:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8114:x1869752792262784:12345-192.168.201.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783135410.093533:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8114:x1869752792262784:12345-192.168.201.60@tcp:503:mount.lustre.0 Request processed in 286us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135410.093542:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 216 00000100:00100000:3.0:1783135410.100244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135410.101039:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792262912 00000100:00100000:0.0:1783135410.101051:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792262912 00000100:00100000:0.0:1783135410.101142:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 217 00000100:00100000:0.0:1783135410.101153:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8120:x1869752792262912:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135410.102192:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8120:x1869752792262912:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 903us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135410.102205:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 217 00010000:00010000:1.0:1783135410.108135:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135410.110596:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135410.110847:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792263040 00000100:00100000:1.0:1783135410.110875:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792263040 00000100:00100000:1.0:1783135410.110931:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 218 00000100:00100000:1.0:1783135410.110941:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8120:x1869752792263040:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135410.111215:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:8120:x1869752792263040:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 274us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135410.111224:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 218 00000100:00100000:3.0:1783135410.118671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135410.119028:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792263552 00000100:00100000:1.0:1783135410.119038:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792263552 00000100:00100000:1.0:1783135410.119112:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 65 00000100:00100000:1.0:1783135410.119123:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792263552:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135410.119792:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792263552:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 666us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135410.119802:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 65 00000100:00080000:0.0:1783135410.119975:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135410.120094:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135410.130324:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792263168 00000100:00100000:0.0:1783135410.130341:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792263168 00000100:00100000:1.0:1783135410.130485:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:1.0:1783135410.130494:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2359:x1869752792263168:12345-192.168.201.60@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783135410.130545:0:9499:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 39ee5324-0b44-4a89-a00a-214bdc9ac96f@192.168.201.60@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:1.0:1783135410.130588:0:9499:0:(genops.c:1406:class_connect()) connect: client 39ee5324-0b44-4a89-a00a-214bdc9ac96f, cookie 0xf646e0cda875c990 00000004:00100000:1.0:1783135410.130633:0:9499:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783135410.131019:0:9499:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf6f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135410.131111:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2359:x1869752792263168:12345-192.168.201.60@tcp:38:mount.lustre.0 Request processed in 615us (11016us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135410.131119:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:2.0:1783135410.134771:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135410.134862:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135410.135095:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792263296 00000100:00100000:3.0:1783135410.135104:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792263296 00000100:00100000:3.0:1783135410.135175:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792263424 00000100:00100000:3.0:1783135410.135178:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792263424 00000100:00100000:3.0:1783135410.135202:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:3.0:1783135410.135213:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+7:0:x1869752792263296:12345-192.168.201.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783135410.135264:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783135410.135347:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c374380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+7:0:x1869752792263296:12345-192.168.201.60@tcp:41:mount.lustre.0 Request processed in 135us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135410.135355:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:3.0:1783135410.135371:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:3.0:1783135410.135378:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:8114:x1869752792263424:12345-192.168.201.60@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783135410.135390:0:5796:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783135410.135410:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:8114:x1869752792263424:12345-192.168.201.60@tcp:41:mount.lustre.0 Request processed in 33us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135410.135416:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00080000:0.0:1783135410.135617:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135410.140550:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135410.140645:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792263680 00000100:00100000:3.0:1783135410.140656:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792263680 00000100:00100000:3.0:1783135410.140732:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:3.0:1783135410.140743:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:8114:x1869752792263680:12345-192.168.201.60@tcp:40:mount.lustre.0 00000100:00100000:3.0:1783135410.140890:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:8114:x1869752792263680:12345-192.168.201.60@tcp:40:mount.lustre.0 Request processed in 148us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135410.140897:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:3.0:1783135410.144927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135410.144965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135410.145002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135410.145176:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792263808 00000100:00100000:1.0:1783135410.145189:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792263808 00000100:00100000:1.0:1783135410.145236:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792263936 00000100:00100000:1.0:1783135410.145239:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792263936 00000100:00100000:1.0:1783135410.145263:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:1.0:1783135410.145271:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1869752792263808:12345-192.168.201.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783135410.145322:0:8303:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 39ee5324-0b44-4a89-a00a-214bdc9ac96f@192.168.201.60@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:1.0:1783135410.145359:0:8303:0:(genops.c:1406:class_connect()) connect: client 39ee5324-0b44-4a89-a00a-214bdc9ac96f, cookie 0xf646e0cda875c997 00002000:00100000:1.0:1783135410.145371:0:8303:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 39ee5324-0b44-4a89-a00a-214bdc9ac96f/ffff8e8f3bf6d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135410.145397:0:8303:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783135410.145643:0:8303:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135410.145678:0:8303:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf6e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135410.145750:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2359:x1869752792263808:12345-192.168.201.60@tcp:8:mount.lustre.0 Request processed in 479us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135410.145758:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:1.0:1783135410.145791:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:1.0:1783135410.145797:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1869752792263936:12345-192.168.201.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1783135410.145845:0:8303:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 39ee5324-0b44-4a89-a00a-214bdc9ac96f@192.168.201.60@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:1.0:1783135410.145876:0:8303:0:(genops.c:1406:class_connect()) connect: client 39ee5324-0b44-4a89-a00a-214bdc9ac96f, cookie 0xf646e0cda875c99e 00002000:00100000:1.0:1783135410.145883:0:8303:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 39ee5324-0b44-4a89-a00a-214bdc9ac96f/ffff8e8f3bf6d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135410.145889:0:8303:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783135410.146006:0:8303:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783135410.146019:0:8303:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf68000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135410.146041:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2359:x1869752792263936:12345-192.168.201.60@tcp:8:mount.lustre.0 Request processed in 244us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135410.146048:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:2.0:1783135410.146512:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792264064 00000100:00100000:2.0:1783135410.146518:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792264064 00000100:00100000:2.0:1783135410.146563:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:2.0:1783135410.146571:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:8114:x1869752792264064:12345-192.168.201.60@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783135410.146754:0:5797:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783135410.146945:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:8114:x1869752792264064:12345-192.168.201.60@tcp:33:mount.lustre.0 Request processed in 373us (1977us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135410.146953:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1 00000001:00100000:2.0:1783135410.379066:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 39ee5324-0b44-4a89-a00a-214bdc9ac96f 00000100:00100000:0.0:1783135410.811272:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813268736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135410.811360:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135410.811913:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813268736 00000100:00100000:1.0:1783135410.811923:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813268736 00000100:00100000:1.0:1783135410.811996:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135410.812007:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813268736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135410.812046:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135410.812117:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813268736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135410.812125:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1783135410.812609:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135410.817010:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bf8a80 x1869752813268736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135410.817043:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813268736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783135411.134918:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135411.919575:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 39ee5324-0b44-4a89-a00a-214bdc9ac96f 00010000:00010000:3.0:1783135412.153986:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135413.178504:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135413.370143:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813268992:0@lo:400:kworker.0 00000100:00100000:3.0:1783135413.370661:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813269248:0@lo:400:kworker.0 00000100:00100000:1.0:1783135413.370740:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813268864:0@lo:400:kworker.0 00000100:00100000:0.0:1783135413.371774:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135413.375378:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135413.375480:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813269248 00000100:00100000:3.0:1783135413.375490:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813269248 00000100:00100000:3.0:1783135413.375551:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783135413.375561:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813269248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135413.375630:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813269248:12345-0@lo:400:kworker.0 Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135413.375638:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1783135413.375658:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135413.375691:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10531500 x1869752813269248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135413.375728:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813269248:0@lo:400:kworker.0 00000100:00100000:1.0:1783135413.378185:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135413.378262:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813269376:0@lo:400:kworker.0 00000100:00100000:1.0:1783135413.378305:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135413.378355:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813268992 00000100:00100000:1.0:1783135413.378363:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813268992 00000100:00100000:1.0:1783135413.378400:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813269376 00000100:00100000:1.0:1783135413.378403:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813269376 00000100:00100000:1.0:1783135413.378432:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135413.378441:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813268992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135413.378491:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813268992:12345-0@lo:400:kworker.0 Request processed in 51us (6719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135413.378499:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783135413.378521:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135413.378529:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813269376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135413.378561:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813269376:12345-0@lo:400:kworker.0 Request processed in 34us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135413.378567:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135413.378601:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10533b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813269376:0@lo:400:kworker.0 00000100:00100000:3.0:1783135413.378940:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813268864 00000100:00100000:3.0:1783135413.378946:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813268864 00000100:00100000:3.0:1783135413.378985:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1783135413.378994:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813268864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135413.379048:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813268864:12345-0@lo:400:kworker.0 Request processed in 56us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135413.379055:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:3.0:1783135413.379084:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135413.379100:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813268864:0@lo:400:kworker.0 00000100:00100000:3.0:1783135413.379562:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813269120:0@lo:400:kworker.0 00000100:00100000:3.0:1783135413.379597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135413.379627:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813269120 00000100:00100000:3.0:1783135413.379631:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813269120 00000100:00100000:3.0:1783135413.379660:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135413.379667:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813269120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135413.379699:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813269120:12345-0@lo:400:kworker.0 Request processed in 32us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135413.379717:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1783135413.379732:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135413.379749:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813269120:0@lo:400:kworker.0 00000100:00100000:0.0:1783135413.386635:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10533480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813268992:0@lo:400:kworker.0 00000100:00100000:0.0:1783135413.386648:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813269504:0@lo:400:kworker.0 00000100:00100000:0.0:1783135413.386700:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135413.390907:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813269504 00000100:00100000:3.0:1783135413.390921:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813269504 00000100:00080000:3.0:1783135413.391002:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135413.391028:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783135413.391039:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813269504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135413.391194:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813269504:12345-0@lo:400:kworker.0 Request processed in 156us (4492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135413.391202:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1783135413.394068:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10532680 x1869752813269504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135413.394098:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813269504:0@lo:400:kworker.0 00000100:00100000:0.0:1783135413.889602:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813269632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135413.889679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135413.889811:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813269632 00000100:00100000:1.0:1783135413.889835:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813269632 00000100:00100000:1.0:1783135413.889895:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135413.889905:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813269632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135413.889946:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135413.901612:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813269632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 11694us (11918us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135413.901629:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1783135413.907185:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba2d80 x1869752813269632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135413.907221:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813269632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783135414.202383:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135414.973462:0:5817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 39ee5324-0b44-4a89-a00a-214bdc9ac96f 00010000:00010000:3.0:1783135415.226270:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135415.289280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135415.289409:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135415.289450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135415.289486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135415.289513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135415.289539:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792264448 00000100:00100000:3.0:1783135415.289548:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792264448 00000100:00100000:3.0:1783135415.289614:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792264320 00000100:00100000:3.0:1783135415.289618:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792264320 00000100:00100000:3.0:1783135415.289643:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:3.0:1783135415.289653:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792264448:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135415.289747:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792264448:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 95us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135415.289759:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:3.0:1783135415.289775:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:3.0:1783135415.289791:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792264320:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135415.289793:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792264704 00000100:00100000:2.0:1783135415.289797:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792264704 00000100:00100000:2.0:1783135415.289853:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792264576 00000100:00100000:3.0:1783135415.289854:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792264320:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 72us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135415.289856:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792264576 00000100:00100000:3.0:1783135415.289861:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:2.0:1783135415.289877:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:2.0:1783135415.289884:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792264704:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135415.289890:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:3.0:1783135415.289896:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792264576:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135415.289912:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792264704:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135415.289916:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792264576:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 21us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135415.289919:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:3.0:1783135415.289922:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00080000:3.0:1783135415.289934:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135415.289950:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135415.289952:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135415.293408:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792264192 00000100:00100000:0.0:1783135415.293422:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792264192 00000100:00100000:0.0:1783135415.293496:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 220 00000100:00100000:0.0:1783135415.293506:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792264192:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135415.295200:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792264192:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 1686us (5922us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135415.295213:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 220 00000100:00100000:3.0:1783135415.942184:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135415.942219:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813269760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135415.942315:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135415.942408:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813269760 00000100:00100000:3.0:1783135415.942418:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813269760 00000100:00100000:3.0:1783135415.942486:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135415.942497:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813269760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135415.942560:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135415.942613:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813269760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135415.942621:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1783135415.942645:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135415.942696:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba0380 x1869752813269760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135415.942717:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813269760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135416.258423:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783135416.506053:0:10169:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1783135417.277222:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135418.298302:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135418.490300:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813270144:0@lo:400:kworker.0 00000100:00100000:2.0:1783135418.490391:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135418.490453:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783135418.490460:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813270016:0@lo:400:kworker.0 00000100:00100000:2.0:1783135418.490486:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135418.490506:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813270528:0@lo:400:kworker.0 00000100:00100000:2.0:1783135418.490532:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135418.490575:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813270144 00000100:00100000:2.0:1783135418.490584:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813270144 00000100:00100000:2.0:1783135418.490658:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813270016 00000100:00100000:2.0:1783135418.490662:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813270016 00000100:00100000:2.0:1783135418.490686:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135418.490695:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813270144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135418.490853:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783135418.490866:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813270016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135418.490957:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813270016:12345-0@lo:400:kworker.0 Request processed in 95us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135418.490967:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783135418.491026:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813270016:0@lo:400:kworker.0 00000100:00100000:0.0:1783135418.491235:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813270272:0@lo:400:kworker.0 00000100:00100000:0.0:1783135418.491270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135418.491310:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783135418.491316:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813269888:0@lo:400:kworker.0 00000100:00100000:0.0:1783135418.491346:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135418.491368:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813270400:0@lo:400:kworker.0 00000100:00100000:0.0:1783135418.491389:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135418.491495:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813270400 00000100:00100000:3.0:1783135418.491500:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813270400 00000100:00100000:3.0:1783135418.491532:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783135418.491539:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813270400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135418.491583:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10533b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813270400:12345-0@lo:400:kworker.0 Request processed in 45us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135418.491589:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:3.0:1783135418.491605:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135418.491636:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c375880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813270400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135418.491803:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813270528 00000100:00100000:1.0:1783135418.491807:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813270528 00000100:00100000:0.0:1783135418.492097:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813269888 00000100:00100000:0.0:1783135418.492102:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813269888 00000100:00100000:0.0:1783135418.492207:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1783135418.492215:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813269888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135418.492264:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813269888:12345-0@lo:400:kworker.0 Request processed in 50us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135418.492271:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1783135418.492352:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813270272 00000100:00100000:1.0:1783135418.492355:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813270272 00000100:00100000:1.0:1783135418.492376:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783135418.492383:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813270528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135418.492427:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813270528:12345-0@lo:400:kworker.0 Request processed in 45us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135418.492433:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783135418.492464:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135418.492470:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813270272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135418.492501:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813270272:12345-0@lo:400:kworker.0 Request processed in 31us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135418.492506:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1783135418.492543:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c374e00 x1869752813270528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135418.492555:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813270528:0@lo:400:kworker.0 00000100:00100000:2.0:1783135418.492690:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813270144:12345-0@lo:400:kworker.0 Request processed in 1994us (2298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135418.492698:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1783135418.493011:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135418.493016:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135418.493075:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813269888:0@lo:400:kworker.0 00010000:00080000:3.0:1783135418.493091:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c374700 x1869752813270272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135418.493102:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813270272:0@lo:400:kworker.0 00000100:00100000:1.0:1783135418.493863:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813270144:0@lo:400:kworker.0 00000100:00100000:1.0:1783135419.002405:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813270656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135419.002484:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135419.002914:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813270656 00000100:00100000:3.0:1783135419.002925:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813270656 00000100:00100000:3.0:1783135419.003020:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135419.003031:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813270656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135419.003074:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135419.003146:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813270656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135419.003153:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1783135419.003589:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba0380 x1869752813270656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135419.003619:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813270656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783135419.322546:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135420.347620:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135420.407785:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135420.407845:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135420.407869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135420.407886:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135420.407906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135420.407931:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792264832 00000100:00100000:1.0:1783135420.407939:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792264832 00000100:00100000:1.0:1783135420.407986:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 222 00000100:00100000:1.0:1783135420.407995:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792264832:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135420.408035:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792264960 00000100:00100000:2.0:1783135420.408042:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792264960 00000100:00100000:1.0:1783135420.408060:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792264832:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135420.408068:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 222 00000100:00100000:2.0:1783135420.408096:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792265088 00000100:00100000:2.0:1783135420.408101:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792265088 00000100:00100000:1.0:1783135420.408107:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 74 00000100:00100000:1.0:1783135420.408124:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792264960:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135420.408134:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 75 00000100:00100000:2.0:1783135420.408145:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792265088:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135420.408156:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792264960:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 33us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135420.408158:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792265216 00000100:00100000:0.0:1783135420.408164:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792265216 00000100:00100000:1.0:1783135420.408168:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 74 00000100:00100000:2.0:1783135420.408183:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792265088:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 40us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135420.408201:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 75 00000100:00100000:0.0:1783135420.408201:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792265344 00000100:00100000:0.0:1783135420.408204:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792265344 00000100:00100000:1.0:1783135420.408208:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:1.0:1783135420.408218:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792265216:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135420.408232:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:0.0:1783135420.408241:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792265344:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135420.408248:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d666450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792265216:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 29us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135420.408277:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792265344:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 37us (368us total) trans 0 rc 0/0 00000100:00080000:3.0:1783135420.408284:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135420.408288:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135420.408290:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135420.416080:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:0.0:1783135420.419841:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:0.0:1783135421.050182:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813270784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135421.050277:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135421.050510:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813270784 00000100:00100000:1.0:1783135421.050518:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813270784 00000100:00100000:1.0:1783135421.050612:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135421.050622:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813270784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135421.050659:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783135421.050801:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135421.052090:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813270784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1464us (1806us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135421.052102:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1783135421.052186:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba0000 x1869752813270784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135421.052207:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813270784:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783135421.370366:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135422.398835:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135423.418241:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135423.611418:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813271296:0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.611493:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135423.611583:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783135423.611590:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813270912:0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.611626:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135423.611651:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813271424:0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.611689:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135423.611717:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813271040:0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.611955:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135423.611975:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813271552:0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.611997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135423.612017:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135423.612022:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813271168:0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.612041:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135423.612076:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813271296 00000100:00100000:0.0:1783135423.612084:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813271296 00000100:00100000:0.0:1783135423.612142:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813271552 00000100:00100000:0.0:1783135423.612145:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813271552 00000100:00100000:0.0:1783135423.612171:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783135423.612180:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813271296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.612248:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813271296:12345-0@lo:400:kworker.0 Request processed in 68us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135423.612255:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783135423.612271:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783135423.612277:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813271552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.612307:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813271552:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135423.612313:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783135423.612331:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813270912 00000100:00100000:0.0:1783135423.612334:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813270912 00000100:00100000:0.0:1783135423.612358:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783135423.612364:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813270912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.612392:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813270912:12345-0@lo:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135423.612398:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1783135423.612422:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813271424 00000100:00100000:0.0:1783135423.612426:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813271424 00000100:00100000:0.0:1783135423.612448:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813271040 00000100:00100000:0.0:1783135423.612450:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813271040 00000100:00100000:0.0:1783135423.612460:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813271168 00000100:00100000:0.0:1783135423.612463:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813271168 00000100:00100000:0.0:1783135423.612476:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783135423.612481:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813271424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.612532:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813271424:12345-0@lo:400:kworker.0 Request processed in 43us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135423.612538:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783135423.612551:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783135423.612563:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813271040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.612594:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813271040:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135423.612600:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783135423.612611:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135423.612617:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813271168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.612640:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813271168:12345-0@lo:400:kworker.0 Request processed in 24us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135423.612645:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1783135423.612671:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135423.612676:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135423.612678:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135423.612718:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813271168:0@lo:400:kworker.0 00000100:00100000:0.0:1783135423.615718:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813271040:0@lo:400:kworker.0 00000100:00100000:1.0:1783135423.618490:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813270912:0@lo:400:kworker.0 00000100:00100000:1.0:1783135423.618539:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813271424:0@lo:400:kworker.0 00010000:00080000:1.0:1783135423.618557:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10532a00 x1869752813271296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135423.618570:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813271296:0@lo:400:kworker.0 00010000:00080000:0.0:1783135423.620018:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10530700 x1869752813271552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135423.620037:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813271552:0@lo:400:kworker.0 00000100:00100000:2.0:1783135424.125244:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813271680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135424.125339:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135424.133017:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813271680 00000100:00100000:1.0:1783135424.133042:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813271680 00000100:00100000:1.0:1783135424.133167:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135424.133178:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813271680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135424.133219:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135424.133312:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813271680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (7972us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135424.133319:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1783135424.133898:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba0000 x1869752813271680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135424.133931:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813271680:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783135424.441943:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135425.468245:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135425.526252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135425.526292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135425.526321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135425.526338:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135425.526358:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135425.526383:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792265856 00000100:00100000:3.0:1783135425.526392:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792265856 00000100:00100000:3.0:1783135425.526455:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792265984 00000100:00100000:3.0:1783135425.526457:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792265984 00000100:00100000:3.0:1783135425.526478:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:3.0:1783135425.526487:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792265856:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135425.526607:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792265856:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 121us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135425.526614:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:3.0:1783135425.526631:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:3.0:1783135425.526637:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792265984:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135425.526672:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792265984:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135425.526677:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:3.0:1783135425.526696:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792265472 00000100:00100000:3.0:1783135425.526699:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792265472 00000100:00100000:3.0:1783135425.526722:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 224 00000100:00100000:3.0:1783135425.526728:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792265472:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135425.526751:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792265472:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 24us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135425.526760:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 224 00000100:00100000:3.0:1783135425.526788:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792265600 00000100:00100000:3.0:1783135425.526803:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792265600 00000100:00100000:3.0:1783135425.526870:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792265728 00000100:00100000:3.0:1783135425.526874:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792265728 00000100:00100000:3.0:1783135425.526896:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:3.0:1783135425.526902:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792265600:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135425.526931:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792265600:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 29us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135425.526945:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:3.0:1783135425.526958:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 80 00000100:00100000:3.0:1783135425.526964:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792265728:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135425.526990:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792265728:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135425.526996:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 80 00000100:00080000:3.0:1783135425.527016:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135425.527021:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135425.527024:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135426.173521:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135426.173548:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813271808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135426.173627:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135426.173758:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813271808 00000100:00100000:3.0:1783135426.173768:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813271808 00000100:00100000:3.0:1783135426.173914:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783135426.173926:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813271808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135426.173967:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135426.174016:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813271808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135426.174023:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1783135426.174089:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783135426.175986:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba2300 x1869752813271808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135426.176014:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813271808:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783135426.495703:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135427.514166:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135428.538325:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135428.732340:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813271936:0@lo:400:kworker.0 00000100:00100000:1.0:1783135428.732352:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813272064:0@lo:400:kworker.0 00000100:00100000:1.0:1783135428.736917:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135428.737046:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813272064 00000100:00100000:1.0:1783135428.737058:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813272064 00000100:00100000:1.0:1783135428.737121:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783135428.737133:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813272064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135428.737211:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813272064:12345-0@lo:400:kworker.0 Request processed in 81us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135428.737220:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783135428.737282:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813272064:0@lo:400:kworker.0 00000100:00100000:1.0:1783135428.737367:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813272192:0@lo:400:kworker.0 00000100:00100000:1.0:1783135428.737403:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135428.737451:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813272192 00000100:00100000:1.0:1783135428.737455:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813272192 00000100:00100000:1.0:1783135428.737493:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135428.737500:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813272192:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783135428.737887:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135428.738032:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813272576:0@lo:400:kworker.0 00000100:00100000:3.0:1783135428.738073:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135428.738299:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813272576 00000100:00100000:3.0:1783135428.738306:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813272576 00000100:00100000:3.0:1783135428.738351:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783135428.738360:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813272576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135428.738424:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813272576:12345-0@lo:400:kworker.0 Request processed in 64us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135428.738433:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1783135428.738467:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783135428.738496:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba2300 x1869752813272576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135428.738511:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813272576:0@lo:400:kworker.0 00000100:00100000:2.0:1783135428.738672:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135428.738718:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813272448:0@lo:400:kworker.0 00000100:00100000:2.0:1783135428.738748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135428.738769:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783135428.738776:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813272320:0@lo:400:kworker.0 00000100:00100000:2.0:1783135428.738802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135428.738864:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813272320 00000100:00100000:2.0:1783135428.738869:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813272320 00000100:00100000:3.0:1783135428.738872:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813271936 00000100:00100000:3.0:1783135428.738876:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813271936 00000100:00100000:3.0:1783135428.738902:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783135428.738902:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135428.738908:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813271936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135428.738909:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813272320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135428.738968:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813271936:12345-0@lo:400:kworker.0 Request processed in 59us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135428.738975:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1783135428.738988:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813272192:12345-0@lo:400:kworker.0 Request processed in 1488us (1584us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135428.739006:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783135428.739020:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813272448 00000100:00100000:1.0:1783135428.739024:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813272448 00000100:00100000:1.0:1783135428.739059:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783135428.739066:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813272448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135428.739099:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813272448:12345-0@lo:400:kworker.0 Request processed in 34us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135428.739106:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783135428.739149:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813272192:0@lo:400:kworker.0 00000100:00080000:3.0:1783135428.740399:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135428.740413:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135428.742344:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813272448:0@lo:400:kworker.0 00000100:00100000:3.0:1783135428.742372:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813271936:0@lo:400:kworker.0 00010000:00080000:3.0:1783135428.742413:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba0380 x1869752813272320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135428.742425:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813272320:12345-0@lo:400:kworker.0 Request processed in 3514us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135428.742426:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813272320:0@lo:400:kworker.0 00000100:00100000:2.0:1783135428.742449:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135429.249273:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135429.249306:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813272704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135429.249403:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135429.249531:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813272704 00000100:00100000:3.0:1783135429.249543:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813272704 00000100:00100000:3.0:1783135429.249606:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135429.249617:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813272704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135429.249670:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135429.249744:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813272704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135429.249754:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1783135429.249808:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba0380 x1869752813272704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135429.249864:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813272704:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783135429.568241:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135430.587862:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135430.653525:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135430.653567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135430.653603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135430.653642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135430.653743:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135430.653785:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792266496 00000100:00100000:2.0:1783135430.653798:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792266496 00000100:00100000:2.0:1783135430.653953:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792266624 00000100:00100000:2.0:1783135430.653957:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792266624 00000100:00100000:2.0:1783135430.653988:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:2.0:1783135430.654001:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2359:x1869752792266496:12345-192.168.201.60@tcp:9:kworker.0 00000020:00000080:2.0:1783135430.654046:0:8303:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c997 00000100:00080000:2.0:1783135430.654057:0:8303:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf6e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783135430.654111:0:8303:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783135430.654569:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+2:2359:x1869752792266496:12345-192.168.201.60@tcp:9:kworker.0 Request processed in 568us (1056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135430.654580:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:2.0:1783135430.654605:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:2.0:1783135430.654612:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2359:x1869752792266624:12345-192.168.201.60@tcp:9:kworker.0 00000020:00000080:2.0:1783135430.654631:0:8303:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c99e 00000100:00080000:2.0:1783135430.654640:0:8303:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf68000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783135430.654674:0:8303:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783135430.659384:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c377b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+2:2359:x1869752792266624:12345-192.168.201.60@tcp:9:kworker.0 Request processed in 4752us (5795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135430.659417:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:2.0:1783135430.659477:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792266112 00000100:00100000:2.0:1783135430.659488:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792266112 00000100:00100000:2.0:1783135430.660474:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 226 00000100:00100000:2.0:1783135430.660490:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792266112:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135430.660576:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792266112:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 90us (6970us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135430.660602:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 226 00010000:00010000:1.0:1783135430.665014:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135430.666957:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792266368 00000100:00100000:2.0:1783135430.666982:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792266368 00000100:00100000:2.0:1783135430.667061:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792266240 00000100:00100000:2.0:1783135430.667065:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792266240 00000100:00100000:2.0:1783135430.667100:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00100000:2.0:1783135430.667111:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792266368:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135430.667238:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c374700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792266368:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 129us (13594us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135430.667247:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00100000:2.0:1783135430.667267:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 85 00000100:00100000:2.0:1783135430.667274:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792266240:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135430.667300:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792266240:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 27us (13557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135430.667306:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 85 00000100:00080000:2.0:1783135430.667331:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135430.667338:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135430.667341:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783135430.667364:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783135430.844314:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 39ee5324-0b44-4a89-a00a-214bdc9ac96f 00000020:00000080:2.0:1783135430.844324:0:7494:0:(genops.c:906:class_export_put()) final put ffff8e8f3bf6d000/39ee5324-0b44-4a89-a00a-214bdc9ac96f 00000020:00000080:1.0:1783135430.844428:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3bf6d000/39ee5324-0b44-4a89-a00a-214bdc9ac96f for lustre-OST0001 00000020:00000080:1.0:1783135430.844548:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3bf68000 for lustre-OST0001 00000100:00100000:2.0:1783135431.298667:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813272832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135431.298741:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135431.298810:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813272832 00000100:00100000:2.0:1783135431.298833:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813272832 00000100:00100000:2.0:1783135431.298890:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783135431.298910:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813272832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135431.298946:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135431.298991:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813272832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135431.298998:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1783135431.299019:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783135431.299047:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c374e00 x1869752813272832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135431.299065:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813272832:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783135431.611099:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783135432.353000:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 39ee5324-0b44-4a89-a00a-214bdc9ac96f 00000020:00000080:3.0:1783135432.353011:0:6616:0:(genops.c:906:class_export_put()) final put ffff8e8f3bf6d800/39ee5324-0b44-4a89-a00a-214bdc9ac96f 00000020:00000080:1.0:1783135432.353292:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3bf6d800/39ee5324-0b44-4a89-a00a-214bdc9ac96f for lustre-OST0000 00000020:00000080:1.0:1783135432.353339:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3bf6e800 for lustre-OST0000 00010000:00010000:2.0:1783135432.635772:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135433.658264:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135433.850669:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813273088:0@lo:400:kworker.0 00000100:00100000:1.0:1783135433.850678:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813273216:0@lo:400:kworker.0 00000100:00100000:3.0:1783135433.850782:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813272960:0@lo:400:kworker.0 00000100:00100000:2.0:1783135433.850838:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813273344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135433.852474:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135433.857969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135433.858266:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813273600:0@lo:400:kworker.0 00000100:00100000:0.0:1783135433.858326:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135433.858427:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813273216 00000100:00100000:0.0:1783135433.858436:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813273216 00000100:00100000:0.0:1783135433.858509:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813273088 00000100:00100000:0.0:1783135433.858513:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813273088 00000100:00100000:0.0:1783135433.858557:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783135433.858569:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135433.858570:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813273216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135433.858588:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813273088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135433.858657:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813273088:12345-0@lo:400:kworker.0 Request processed in 75us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135433.858665:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813273216:12345-0@lo:400:kworker.0 Request processed in 97us (6196us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135433.858669:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783135433.858679:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783135433.858756:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813273216:0@lo:400:kworker.0 00000100:00100000:0.0:1783135433.858795:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813273088:0@lo:400:kworker.0 00000100:00080000:0.0:1783135433.859010:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135433.859141:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813273600 00000100:00100000:0.0:1783135433.859146:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813273600 00000100:00100000:0.0:1783135433.859183:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135433.859189:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813273600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135433.859229:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813273600:12345-0@lo:400:kworker.0 Request processed in 40us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135433.859236:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1783135433.859373:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783135433.859394:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f02d12300 x1869752813273600/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135433.859405:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813273600:0@lo:400:kworker.0 00000100:00100000:3.0:1783135433.864258:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135433.864328:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813273472:0@lo:400:kworker.0 00000100:00100000:3.0:1783135433.864401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135433.864447:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813273472 00000100:00100000:3.0:1783135433.864455:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813273472 00000100:00100000:3.0:1783135433.864526:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1783135433.864535:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813273472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135433.864592:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813273472:12345-0@lo:400:kworker.0 Request processed in 58us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135433.864598:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1783135433.864640:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135433.864679:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813273472:0@lo:400:kworker.0 00000100:00100000:2.0:1783135433.864687:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135433.864721:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813273344 00000100:00100000:3.0:1783135433.864726:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813273344 00000100:00100000:3.0:1783135433.864766:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783135433.864773:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813273344:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783135433.864780:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135433.864846:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813273344:12345-0@lo:400:kworker.0 Request processed in 43us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135433.864856:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1783135433.864857:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f02d12680 x1869752813273344/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135433.864871:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813273344:0@lo:400:kworker.0 00000100:00100000:1.0:1783135433.865156:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813272960 00000100:00100000:1.0:1783135433.865161:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813272960 00000100:00100000:1.0:1783135433.865197:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783135433.865203:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813272960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135433.865251:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813272960:12345-0@lo:400:kworker.0 Request processed in 49us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135433.865257:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783135433.866107:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813272960:0@lo:400:kworker.0 00000100:00100000:2.0:1783135434.366731:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135434.366756:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813273728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135434.366858:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135434.366906:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813273728 00000100:00100000:2.0:1783135434.366913:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813273728 00000100:00100000:2.0:1783135434.366961:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135434.366971:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813273728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135434.367024:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135434.367067:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813273728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135434.367074:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1783135434.367151:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3cba2300 x1869752813273728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135434.367169:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813273728:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783135434.688254:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135435.283342:0:10870:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1783135435.707703:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135435.774127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135435.774177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135435.774248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135435.774374:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792266752 00000100:00100000:2.0:1783135435.774384:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792266752 00000100:00100000:2.0:1783135435.774457:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 228 00000100:00100000:2.0:1783135435.774468:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792266752:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135435.774546:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792266752:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 79us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135435.774554:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 228 00000100:00100000:1.0:1783135435.774567:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792267008 00000100:00100000:1.0:1783135435.774573:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792267008 00000100:00100000:1.0:1783135435.774624:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792266880 00000100:00100000:1.0:1783135435.774628:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792266880 00000100:00100000:1.0:1783135435.774650:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 89 00000100:00100000:1.0:1783135435.774658:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792267008:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135435.774703:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792267008:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 46us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135435.774709:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 89 00000100:00100000:1.0:1783135435.774741:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 90 00000100:00100000:1.0:1783135435.774749:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792266880:12345-192.168.201.60@tcp:400:kworker.0 00000100:00080000:0.0:1783135435.774844:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135435.780670:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792266880:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 5907us (6407us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135435.780684:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 90 00000100:00100000:3.0:1783135436.410155:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135436.410176:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813273856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135436.410253:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135436.410386:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813273856 00000100:00100000:2.0:1783135436.410394:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813273856 00000100:00100000:2.0:1783135436.410663:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783135436.410672:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813273856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135436.410705:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135436.410748:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813273856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135436.410755:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1783135436.410800:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783135436.410847:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c69ea00 x1869752813273856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135436.410865:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c69ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813273856:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783135436.734229:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135437.754044:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135438.787482:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135438.970107:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813274368:0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.970193:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135438.970272:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135438.970280:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813273984:0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.970310:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135438.970333:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813274496:0@lo:400:kworker.0 00000100:00100000:3.0:1783135438.970502:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813273984 00000100:00100000:3.0:1783135438.970510:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813273984 00000100:00100000:3.0:1783135438.970549:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1783135438.970557:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813273984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135438.970612:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813273984:12345-0@lo:400:kworker.0 Request processed in 56us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135438.970619:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1783135438.970736:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135438.970774:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813273984:0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.970803:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813274112:0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.970848:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135438.970864:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813274624:0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.970881:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135438.970895:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135438.970899:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813274240:0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.970915:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135438.970937:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813274368 00000100:00100000:1.0:1783135438.970941:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813274368 00000100:00100000:1.0:1783135438.970969:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813274624 00000100:00100000:1.0:1783135438.970972:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813274624 00000100:00100000:1.0:1783135438.970989:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135438.970995:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813274368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.971030:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813274368:12345-0@lo:400:kworker.0 Request processed in 35us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135438.971036:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135438.971050:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135438.971055:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813274624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.971083:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813274624:12345-0@lo:400:kworker.0 Request processed in 28us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135438.971089:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135438.971105:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813274496 00000100:00100000:1.0:1783135438.971108:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813274496 00000100:00100000:1.0:1783135438.971128:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813274112 00000100:00100000:1.0:1783135438.971130:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813274112 00000100:00100000:1.0:1783135438.971138:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813274240 00000100:00100000:1.0:1783135438.971140:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813274240 00000100:00100000:1.0:1783135438.971158:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783135438.971162:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813274496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.971188:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813274496:12345-0@lo:400:kworker.0 Request processed in 26us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135438.971193:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783135438.971201:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783135438.971206:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813274112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.971224:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813274112:12345-0@lo:400:kworker.0 Request processed in 18us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135438.971229:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783135438.971236:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783135438.971240:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813274240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.971279:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813274240:12345-0@lo:400:kworker.0 Request processed in 38us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135438.971285:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783135438.971323:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813274240:0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.971332:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813274112:0@lo:400:kworker.0 00010000:00080000:1.0:1783135438.971343:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f02d10700 x1869752813274624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135438.971465:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813274624:0@lo:400:kworker.0 00000100:00100000:1.0:1783135438.971493:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813274496:0@lo:400:kworker.0 00010000:00080000:1.0:1783135438.971502:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f02d13800 x1869752813274368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135438.971523:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813274368:0@lo:400:kworker.0 00000100:00080000:3.0:1783135438.971606:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135438.971610:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135438.971612:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1783135439.118540:0:11020:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda2107720 20000000:00000080:1.0:1783135439.118624:0:11020:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8f3fc6a800 uarg=0000000000000000 20000000:01000000:1.0:1783135439.118663:0:11020:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783135439.118669:0:11020:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783135439.118674:0:11020:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783135439.119738:0:11021:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783135439.120336:0:11020:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783135439.127426:0:11020:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783135439.127459:0:11020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.127480:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.127491:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c951 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.127498:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c95f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.127505:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c96d expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.127513:0:11020:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.127521:0:11020:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.127656:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.127674:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 12 pid: 5787 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135439.127689:0:11020:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813274752:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135439.127996:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c96d expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.128005:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c96d expref: 18 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135439.128014:0:11020:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d12a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813274880:0@lo:104: 00000100:00100000:1.0:1783135439.128098:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135439.128138:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813274880 00000100:00100000:1.0:1783135439.128146:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813274880 00000100:00100000:1.0:1783135439.128192:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783135439.128201:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:11020:x1869752813274880:12345-0@lo:104: 00010000:00010000:1.0:1783135439.128213:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.128274:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135439.128280:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:11020:x1869752813274880:12345-0@lo:104: Request processed in 81us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135439.128287:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:1.0:1783135439.128320:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c95f expref: 18 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.128335:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c95f expref: 18 pid: 5789 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135439.128344:0:11020:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813275008:0@lo:104: 00000100:00100000:1.0:1783135439.128378:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135439.128399:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c951 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.128408:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c951 expref: 18 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135439.128416:0:11020:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813275136:0@lo:104: 00000100:00100000:1.0:1783135439.128434:0:11020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135439.128452:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813275008 00000100:00100000:1.0:1783135439.128455:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813275008 00000100:00100000:1.0:1783135439.128470:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813275136 00000100:00100000:1.0:1783135439.128473:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813275136 00000100:00100000:1.0:1783135439.128485:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783135439.128492:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:11020:x1869752813275008:12345-0@lo:104: 00010000:00010000:1.0:1783135439.128500:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.128532:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783135439.128537:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:11020:x1869752813275008:12345-0@lo:104: Request processed in 46us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135439.128542:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783135439.128555:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135439.129312:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:11020:x1869752813275136:12345-0@lo:104: 00010000:00010000:1.0:1783135439.129329:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.129652:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783135439.129658:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:11020:x1869752813275136:12345-0@lo:104: Request processed in 353us (1223us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135439.129666:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1783135439.129718:0:11020:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.129729:0:11020:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 12 pid: 5789 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135439.129741:0:11020:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813275264:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135439.129789:0:11020:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135439.129809:0:11020:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d12a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813274880:0@lo:104: 00000100:00100000:1.0:1783135439.129843:0:11020:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813275008:0@lo:104: 00000100:00100000:1.0:1783135439.129850:0:11020:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813275136:0@lo:104: 00010000:00010000:1.0:1783135439.133289:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135439.133303:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133314:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42157800 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135439.133318:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133328:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135439.133365:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135439.133371:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135439.133427:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133433:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135439.133459:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133466:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42157800/0xf646e0cda875c96d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c974 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133481:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135439.133485:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133490:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42156a00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135439.133492:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133499:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135439.133505:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135439.133510:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135439.133529:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133535:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135439.133550:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133556:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42156a00/0xf646e0cda875c95f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c966 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133577:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135439.133580:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133586:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2400 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135439.133589:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133595:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135439.133610:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135439.133615:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135439.133627:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133632:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135439.133638:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133654:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b2400/0xf646e0cda875c951 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c958 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.133666:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135439.133668:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135439.133670:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135439.133688:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813275392:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135439.133758:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135439.133850:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813275520:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135439.133872:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135439.133893:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135439.133898:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813275648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135439.133916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135439.134639:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813275392 00000100:00100000:2.0:1783135439.134649:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813275392 00010000:00010000:2.0:1783135439.134682:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c96d expref: 19 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135439.134719:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813275520 00000100:00100000:2.0:1783135439.134722:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813275520 00010000:00010000:2.0:1783135439.134734:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c95f expref: 20 pid: 5789 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135439.134745:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813275648 00000100:00100000:2.0:1783135439.134747:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813275648 00010000:00010000:2.0:1783135439.134756:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c951 expref: 21 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135439.134769:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135439.134777:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+21:3314:x1869752813275392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135439.134789:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135439.134794:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c96d expref: 21 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.134803:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c96d expref: 21 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.134842:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f00030600/0xf646e0cda875c974 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c96d expref: 21 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.134857:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135439.134899:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c8b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+20:3314:x1869752813275392:12345-0@lo:103:ldlm_bl.0 Request processed in 122us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135439.134918:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135439.134965:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135439.134971:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813275520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135439.134977:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135439.134982:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c95f expref: 19 pid: 5789 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.134991:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c95f expref: 19 pid: 5789 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.135001:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42157000/0xf646e0cda875c966 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c95f expref: 19 pid: 5789 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.135010:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135439.135034:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:3311:x1869752813275520:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135439.135040:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135439.135051:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135439.135056:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:3311:x1869752813275648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135439.135064:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135439.135069:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c951 expref: 17 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.135077:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c951 expref: 17 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.135087:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156400/0xf646e0cda875c958 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c951 expref: 17 pid: 5788 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135439.135106:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135439.135126:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3311:x1869752813275648:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (1208us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135439.135132:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1783135439.135150:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135439.135155:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135439.135181:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813275648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135439.135190:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813275520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135439.135218:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813275392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135439.136119:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135439.136153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135439.136212:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792267136 00000100:00100000:3.0:1783135439.136218:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792267136 00010000:00010000:3.0:1783135439.136244:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 13 pid: 5787 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135439.136282:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792267264 00000100:00100000:3.0:1783135439.136285:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792267264 00010000:00010000:3.0:1783135439.136297:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 14 pid: 5789 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135439.136313:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:3.0:1783135439.136321:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+14:2361:x1869752792267136:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135439.136332:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135439.136338:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 14 pid: 5787 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136358:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 14 pid: 5787 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136372:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135439.136414:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+14:2361:x1869752792267136:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 94us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135439.136421:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:3.0:1783135439.136438:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:3.0:1783135439.136444:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792267264:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135439.136451:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135439.136465:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 13 pid: 5789 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136473:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 13 pid: 5789 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136483:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136491:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136505:0:5781:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136512:0:5781:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136518:0:5781:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136524:0:5781:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136530:0:5781:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f00030a00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135439.136534:0:5781:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136541:0:5781:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136549:0:5781:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135439.136940:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135439.136964:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792267264:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 519us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135439.136970:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 29 00010000:00010000:1.0:1783135439.138639:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05221400/0xf646e0cda875c989 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d6e expref: 12 pid: 5787 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135439.138661:0:11020:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d13800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813274752:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135439.138677:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487c00/0xf646e0cda875c94a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d36 expref: 11 pid: 5789 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135439.138684:0:11020:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d10a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11020:1869752813275264:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135439.138717:0:11020:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.138728:0:11020:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.138753:0:11020:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135439.138759:0:11020:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f00030a00/0xf646e0cda875c9a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11020 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135439.482246:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135439.482279:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813275776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135439.482355:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135439.483870:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813275776 00000100:00100000:2.0:1783135439.483883:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813275776 00000100:00100000:2.0:1783135439.483942:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135439.483952:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813275776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135439.483992:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135439.484069:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813275776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1714us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135439.484075:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1783135439.484199:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c69d880 x1869752813275776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135439.484218:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c69d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813275776:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783135439.802112:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135440.825801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135440.825944:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792267392 00000100:00100000:3.0:1783135440.825956:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792267392 00000100:00100000:3.0:1783135440.826007:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 230 00000100:00100000:3.0:1783135440.826017:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:5578:x1869752792267392:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135440.826034:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135440.826055:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d98 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135440.826082:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135440.826094:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135440.826114:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486400, rc 0) 00000100:00100000:3.0:1783135440.826167:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792267392:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 Request processed in 151us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.826174:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 230 00010000:00010000:2.0:1783135440.826294:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135440.836034:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135440.837123:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792267520 00000100:00100000:2.0:1783135440.837134:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792267520 00000100:00100000:2.0:1783135440.837313:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 231 00000100:00100000:2.0:1783135440.837326:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792267520:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135440.837671:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792267520:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 Request processed in 346us (1644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.837679:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 231 00000100:00100000:0.0:1783135440.849700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135440.849789:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792267648 00000100:00100000:0.0:1783135440.849797:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792267648 00000100:00100000:0.0:1783135440.849859:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 232 00000100:00100000:0.0:1783135440.849869:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792267648:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135440.850109:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792267648:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 Request processed in 240us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135440.850118:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 232 00000100:00100000:3.0:1783135440.863094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135440.863195:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792267776 00000100:00100000:0.0:1783135440.863205:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792267776 00000100:00100000:0.0:1783135440.863260:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 233 00000100:00100000:0.0:1783135440.863269:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792267776:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135440.863285:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135440.863301:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11d9f expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135440.863328:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135440.863350:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135440.863360:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05221000, rc 0) 00000100:00100000:0.0:1783135440.863423:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792267776:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 Request processed in 154us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135440.863430:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 233 00000100:00100000:3.0:1783135440.874215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135440.874316:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792267904 00000100:00100000:3.0:1783135440.874392:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792267904 00000100:00100000:3.0:1783135440.875049:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 234 00000100:00100000:3.0:1783135440.875060:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792267904:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135440.875739:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792267904:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 Request processed in 678us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.875749:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 234 00000100:00100000:2.0:1783135440.881718:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135440.882051:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792268032 00000100:00100000:3.0:1783135440.882060:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792268032 00000100:00100000:3.0:1783135440.882116:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 235 00000100:00100000:3.0:1783135440.882126:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792268032:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135440.882361:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792268032:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 Request processed in 235us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135440.882369:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 235 00000100:00100000:2.0:1783135440.891874:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135440.891914:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792268160 00000100:00100000:2.0:1783135440.891923:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792268160 00000100:00100000:2.0:1783135440.891988:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 94 00000100:00100000:2.0:1783135440.891999:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792268160:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135440.892067:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792268160:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135440.892075:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 94 00000100:00080000:3.0:1783135440.896704:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135440.896709:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135440.897652:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792268288 00000100:00100000:1.0:1783135440.897664:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792268288 00000100:00100000:1.0:1783135440.897738:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 95 00000100:00100000:1.0:1783135440.897748:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2360:x1869752792268288:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135440.897853:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2360:x1869752792268288:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 107us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135440.897861:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 95 00000100:00080000:3.0:1783135440.897942:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1783135441.083233:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135441.083245:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8e0182b800 from 7 10000000:01000000:1.0:1783135441.083250:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135441.083309:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135441.083322:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135441.083335:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135441.083362:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813275904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.083454:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135441.083518:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135441.083594:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813275904 00000100:00100000:3.0:1783135441.083601:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813275904 00000100:00100000:3.0:1783135441.083654:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1783135441.083664:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813275904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135441.083678:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135441.083691:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c9ba expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.083714:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.083725:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 17 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.083742:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486600, rc 0) 00000100:00100000:3.0:1783135441.083790:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813275904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135441.083798:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1783135441.084018:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813275904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135441.084033:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135441.084042:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135441.084107:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.084136:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135441.084161:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2dd80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135441.085837:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813276032 00000100:00100000:3.0:1783135441.085847:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813276032 00000100:00100000:3.0:1783135441.085894:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1783135441.085901:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813276032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135441.086189:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813276032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (2053us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135441.086194:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1783135441.086455:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.086505:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.086556:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135441.086592:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135441.086644:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813276160 00000100:00100000:0.0:1783135441.086648:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813276160 00000100:00100000:0.0:1783135441.086674:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783135441.086679:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813276160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135441.086794:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813276160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135441.086798:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1783135441.086867:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783135441.087858:0:11077:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783135441.090941:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783135441.090981:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135441.090994:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135441.091007:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135441.094489:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135441.094497:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f04f38800 from 7 10000000:01000000:1.0:1783135441.094502:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135441.094549:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135441.094561:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135441.094586:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135441.094613:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.094687:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135441.094736:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135441.094873:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813276288 00000100:00100000:3.0:1783135441.094880:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813276288 00000100:00100000:3.0:1783135441.094935:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783135441.094945:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813276288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135441.094958:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135441.094970:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c9c8 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.094994:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.095004:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.095013:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486000, rc 0) 00000100:00100000:3.0:1783135441.095062:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813276288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135441.095069:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1783135441.095375:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135441.095391:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135441.095401:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135441.095453:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.095481:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135441.095508:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135441.095553:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813276416 00000100:00100000:3.0:1783135441.095558:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813276416 00000100:00100000:3.0:1783135441.095587:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1783135441.095594:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813276416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135441.095856:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813276416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 261us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135441.095863:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1783135441.096021:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.096050:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.096084:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135441.096185:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813276544 00000100:00100000:0.0:1783135441.096190:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813276544 00000100:00100000:0.0:1783135441.096235:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1783135441.096242:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813276544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135441.096387:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813276544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135441.096394:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1783135441.096526:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135441.096540:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783135441.097301:0:11078:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1783135441.097450:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1783135441.097468:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135441.097477:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135441.097488:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135441.097498:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135441.097499:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f063e9800 from 7 10000000:01000000:0.0:1783135441.097501:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135441.097525:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135441.097532:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135441.097540:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135441.097556:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135441.097594:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135441.097625:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f181c7540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135441.097666:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813276672 00000100:00100000:3.0:1783135441.097670:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813276672 00000100:00100000:3.0:1783135441.097698:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1783135441.097703:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813276672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135441.097712:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135441.097721:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875c9d6 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.097734:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.097740:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.097746:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486a00, rc 0) 00000100:00100000:3.0:1783135441.097774:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813276672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135441.097778:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783135441.097889:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135441.097898:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135441.097942:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135441.097984:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.098003:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135441.098020:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135441.098048:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813276800 00000100:00100000:0.0:1783135441.098051:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813276800 00000100:00100000:0.0:1783135441.098072:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783135441.098077:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813276800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135441.098378:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813276800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135441.098385:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1783135441.098487:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.098505:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135441.098537:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135441.098562:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135441.098598:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813276928 00000100:00100000:0.0:1783135441.098602:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813276928 00000100:00100000:0.0:1783135441.098629:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1783135441.098633:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813276928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135441.098785:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813276928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135441.098790:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1783135441.105304:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10531880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813276928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135441.108476:0:11079:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783135441.108799:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783135441.108846:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135441.108857:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135441.108870:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135441.530262:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813277056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135441.530335:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135441.530423:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813277056 00000100:00100000:0.0:1783135441.530431:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813277056 00000100:00100000:0.0:1783135441.530490:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1783135441.530643:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135441.530673:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813277056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135441.530708:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135441.530794:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813277056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 296us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135441.530802:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1783135441.530891:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bd180 x1869752813277056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135441.530910:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813277056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783135441.853922:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135442.881628:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135443.503794:0:11218:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1783135443.903972:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135444.090257:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813277568:0@lo:400:kworker.0 00000100:00100000:3.0:1783135444.090333:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135444.090391:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135444.090397:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813277440:0@lo:400:kworker.0 00000100:00100000:3.0:1783135444.090421:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135444.090455:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813277440 00000100:00100000:3.0:1783135444.090463:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813277440 00000100:00100000:3.0:1783135444.090531:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1783135444.090541:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813277440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135444.090592:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813277440:12345-0@lo:400:kworker.0 Request processed in 53us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135444.090600:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1783135444.090619:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135444.090650:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813277440:0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.090842:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813277312:0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.090874:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135444.090891:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813277824:0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.090912:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135444.090937:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783135444.090943:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813277184:0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.090967:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135444.090987:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813277696:0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.091005:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135444.091031:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813277568 00000100:00100000:1.0:1783135444.091042:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813277568 00000100:00100000:1.0:1783135444.091072:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813277824 00000100:00100000:1.0:1783135444.091075:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813277824 00000100:00100000:1.0:1783135444.091092:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135444.091097:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813277568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.091131:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813277568:12345-0@lo:400:kworker.0 Request processed in 34us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135444.091138:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135444.091149:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135444.091155:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813277824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.091195:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813277824:12345-0@lo:400:kworker.0 Request processed in 40us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135444.091201:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135444.091219:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813277184 00000100:00100000:1.0:1783135444.091222:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813277184 00000100:00100000:1.0:1783135444.091243:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783135444.091248:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813277184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.091277:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813277184:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135444.091282:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1783135444.091314:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813277184:0@lo:400:kworker.0 00010000:00080000:1.0:1783135444.091327:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37c58000 x1869752813277824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135444.091337:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813277824:0@lo:400:kworker.0 00000100:00100000:3.0:1783135444.091414:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813277312 00000100:00100000:3.0:1783135444.091419:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813277312 00000100:00100000:3.0:1783135444.091448:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813277696 00000100:00100000:3.0:1783135444.091451:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813277696 00000100:00100000:1.0:1783135444.091556:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783135444.091564:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813277312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.091607:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813277312:12345-0@lo:400:kworker.0 Request processed in 44us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135444.091613:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783135444.091627:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783135444.091633:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813277696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.091660:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813277696:12345-0@lo:400:kworker.0 Request processed in 27us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135444.091665:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783135444.091690:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813277696:0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.091698:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813277312:0@lo:400:kworker.0 00000100:00080000:1.0:1783135444.091731:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135444.091735:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135444.091737:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135444.091758:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37c58380 x1869752813277568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135444.091768:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813277568:0@lo:400:kworker.0 00000100:00100000:1.0:1783135444.602283:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813277952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135444.602364:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135444.602625:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813277952 00000100:00100000:0.0:1783135444.602638:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813277952 00000100:00100000:0.0:1783135444.602701:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783135444.602712:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813277952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135444.602747:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135444.602841:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813277952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135444.602848:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1783135444.603043:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c69ca80 x1869752813277952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135444.603061:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c69ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813277952:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783135444.924618:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135445.949500:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135446.014741:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135446.014850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135446.014882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135446.014914:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792268672 00000100:00100000:2.0:1783135446.014924:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792268672 00000100:00100000:2.0:1783135446.014988:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792268544 00000100:00100000:2.0:1783135446.014991:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792268544 00000100:00100000:2.0:1783135446.015018:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 99 00000100:00100000:2.0:1783135446.015027:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792268672:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135446.015105:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792268672:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 78us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135446.015113:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 99 00000100:00100000:2.0:1783135446.015132:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 100 00000100:00100000:2.0:1783135446.015163:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792268544:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135446.015193:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792268544:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135446.015199:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 100 00000100:00080000:1.0:1783135446.017779:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135446.021332:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792268416 00000100:00100000:0.0:1783135446.021490:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792268416 00000100:00100000:0.0:1783135446.021559:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 246 00000100:00100000:0.0:1783135446.021571:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792268416:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135446.021659:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792268416:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 90us (6926us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135446.021667:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 246 00000100:00100000:3.0:1783135446.650293:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813278080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135446.650387:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135446.650841:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813278080 00000100:00100000:1.0:1783135446.650864:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813278080 00000100:00100000:1.0:1783135446.650936:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783135446.650955:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813278080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135446.650995:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783135446.651139:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135446.653265:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813278080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1432us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135446.653280:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1783135446.654257:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bc000 x1869752813278080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135462 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135446.654282:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813278080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783135446.977177:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135447.437418:0:11319:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:24:05 (1783135445) === 00000100:00100000:2.0:1783135447.793947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135447.794070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135447.794555:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792268928 00000100:00100000:0.0:1783135447.794566:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792268928 00000100:00100000:0.0:1783135447.794631:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:0.0:1783135447.794642:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0c7819a6-778a-4617-af33-00460db74182+6:9667:x1869752792268928:12345-192.168.201.60@tcp:700:mkdir.0 00000100:00100000:0.0:1783135447.794741:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0c7819a6-778a-4617-af33-00460db74182+6:9667:x1869752792268928:12345-192.168.201.60@tcp:700:mkdir.0 Request processed in 101us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135447.794749:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:3.0:1783135447.795356:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792268800 00000100:00100000:3.0:1783135447.795364:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792268800 00000100:00100000:2.0:1783135447.795488:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:2.0:1783135447.795499:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792268800:12345-192.168.201.60@tcp:41:mkdir.0 00000004:00000024:2.0:1783135447.795548:0:5795:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135447.795659:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792268800:12345-192.168.201.60@tcp:41:mkdir.0 Request processed in 161us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135447.795667:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:1.0:1783135447.821668:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135447.821890:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792269184 00000100:00100000:3.0:1783135447.821903:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792269184 00000100:00100000:3.0:1783135447.821965:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:3.0:1783135447.821975:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:9667:x1869752792269184:12345-192.168.201.60@tcp:36:mkdir.0 00010000:00010000:3.0:1783135447.822042:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135447.822087:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875c8c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d21 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.822119:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:3.0:1783135447.822129:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135447.822408:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.822421:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.822439:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.822465:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.822472:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.822477:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135447.825865:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783135447.825885:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.825896:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.825903:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.825908:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135447.825913:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.825920:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.825938:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840700) 00010000:00010000:3.0:1783135447.825941:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135447.825951:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.825958:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135447.825981:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096c967db reply state 00000000ef6a91c8 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135447.825991:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135447.826076:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+7:9667:x1869752792269184:12345-192.168.201.60@tcp:36:mkdir.0 Request processed in 4100us (4416us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783135447.826085:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 15 00010000:00010000:1.0:1783135447.834973:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135447.834991:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135447.834998:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135447.835004:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135447.835009:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135447.835017:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135447.835037:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8f08840300) 00010000:00010000:1.0:1783135447.835040:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135447.835045:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135447.835052:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875c9eb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135447.849397:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135447.849811:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792269312 00000100:00100000:3.0:1783135447.849862:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792269312 00000100:00100000:3.0:1783135447.849929:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:3.0:1783135447.849940:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:9669:x1869752792269312:12345-192.168.201.60@tcp:101:chmod.0 00010000:00010000:3.0:1783135447.849964:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135447.849987:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875c9f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11da6 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.850052:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.850065:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.850076:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135447.850149:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783135447.850165:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135447.850208:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.850235:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875c9f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11da6 expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.850251:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11da6 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.850260:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840700) 00010000:00010000:3.0:1783135447.850263:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135447.850266:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487600, rc 0) 00000100:00100000:3.0:1783135447.850330:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+7:9669:x1869752792269312:12345-192.168.201.60@tcp:101:chmod.0 Request processed in 392us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135447.850337:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:2.0:1783135447.859692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135447.860176:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792269568 00000100:00100000:0.0:1783135447.860187:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792269568 00000100:00100000:0.0:1783135447.860245:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:0.0:1783135447.860256:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+7:9669:x1869752792269568:12345-192.168.201.60@tcp:36:chmod.0 00010000:00010000:0.0:1783135447.860311:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135447.860339:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875c9f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11da6 expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.860378:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840700) 00010000:00010000:0.0:1783135447.860391:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135447.860417:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.860430:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.860440:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135447.860751:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d15ea8ef reply state 000000007c467512 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135447.860761:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783135447.860775:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783135447.861170:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+8:9669:x1869752792269568:12345-192.168.201.60@tcp:36:chmod.0 Request processed in 915us (1485us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783135447.861177:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 17 00010000:00010000:2.0:1783135447.868274:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.868294:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.868302:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.868308:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135447.868313:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.868322:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.868360:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f180c6800) 00010000:00010000:2.0:1783135447.868363:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135447.868368:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.868374:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875ca00 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135447.900935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135447.901035:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792269696 00000100:00100000:3.0:1783135447.901046:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792269696 00000100:00100000:3.0:1783135447.901118:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:3.0:1783135447.901129:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+7:9670:x1869752792269696:12345-192.168.201.60@tcp:101:chown.0 00010000:00010000:3.0:1783135447.901152:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135447.901175:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dad expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.901239:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487000/0xf646e0cda875ca0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.901313:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487000/0xf646e0cda875ca0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.901344:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487000/0xf646e0cda875ca0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135447.901412:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783135447.901417:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135447.901456:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487000/0xf646e0cda875ca0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.901481:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dad expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.901496:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487000/0xf646e0cda875ca0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dad expref: 8 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.901504:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840900) 00010000:00010000:3.0:1783135447.901507:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135447.901510:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487000, rc 0) 00000100:00100000:3.0:1783135447.901566:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+8:9670:x1869752792269696:12345-192.168.201.60@tcp:101:chown.0 Request processed in 439us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135447.901573:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:3.0:1783135447.907186:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135447.908132:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792269824 00000100:00100000:2.0:1783135447.908144:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792269824 00000100:00100000:2.0:1783135447.908372:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:2.0:1783135447.908385:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+8:9670:x1869752792269824:12345-192.168.201.60@tcp:101:chown.0 00010000:00010000:2.0:1783135447.908418:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135447.908441:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875ca15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11db4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908512:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908527:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908539:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908555:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908561:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908581:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908963:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875ca2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908972:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875ca2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.908980:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875ca2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135447.909021:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783135447.909026:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135447.909051:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875ca2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909064:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909070:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909076:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909081:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135447.909085:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909092:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909125:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840900) 00010000:00010000:2.0:1783135447.909128:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135447.909134:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909140:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909154:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909160:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909166:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909172:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135447.909174:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909180:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909188:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8f18315e00) 00010000:00010000:2.0:1783135447.909190:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135447.909193:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909399:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909508:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875ca15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11db4 expref: 10 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909522:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875ca2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11db4 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135447.909529:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:2.0:1783135447.909531:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135447.909533:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3200, rc 0) 00000100:00100000:2.0:1783135447.909725:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+9:9670:x1869752792269824:12345-192.168.201.60@tcp:101:chown.0 Request processed in 1342us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135447.909733:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:3.0:1783135447.914852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135447.914894:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792270080 00000100:00100000:3.0:1783135447.914903:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792270080 00000100:00100000:3.0:1783135447.914963:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:3.0:1783135447.914972:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+9:9670:x1869752792270080:12345-192.168.201.60@tcp:36:chown.0 00010000:00010000:3.0:1783135447.915030:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135447.915071:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875ca2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11db4 expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.915091:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:3.0:1783135447.915114:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135447.915142:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.915155:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.915164:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135447.954891:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1783135447.954913:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1783135447.954994:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003162f064 reply state 00000000c4614ea3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135447.955009:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1783135447.955199:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1783135447.955300:0:5795:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1783135447.955318:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+7:9670:x1869752792270080:12345-192.168.201.60@tcp:36:chown.0 Request processed in 40343us (40471us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783135447.955326:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 20 00010000:00010000:0.0:1783135447.959681:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.959699:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.959707:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.959713:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135447.959719:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.959750:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.959769:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f08840b00) 00010000:00010000:0.0:1783135447.959772:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135447.959776:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135447.959782:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875ca31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135447.993275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135447.993389:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792270208 00000100:00100000:0.0:1783135447.993400:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792270208 00000100:00100000:0.0:1783135447.993463:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:0.0:1783135447.993475:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+6:9671:x1869752792270208:12345-192.168.201.60@tcp:101:touch.500 00010000:00010000:0.0:1783135447.993503:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135447.993524:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875ca38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dbb expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135447.995575:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783135447.996956:0:9499:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3380us 00010000:00010000:1.0:1783135448.015197:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.015221:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.015232:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.015247:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.015255:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.015262:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.015869:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875ca4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.015880:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875ca4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.015889:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875ca4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135448.015973:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783135448.015977:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135448.016688:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875ca4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016707:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016714:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016722:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016728:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f00030a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135448.016732:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016739:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016752:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840900) 00010000:00010000:1.0:1783135448.016754:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135448.016759:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016765:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030a00/0xf646e0cda875ca3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016777:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016783:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016789:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016802:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f00030600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135448.016804:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016810:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016839:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8f10923a00) 00010000:00010000:1.0:1783135448.016842:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135448.016845:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016861:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f00030600/0xf646e0cda875ca46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016902:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875ca38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dbb expref: 8 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016917:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875ca4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dbb expref: 7 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.016925:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f10923f00) 00010000:00010000:1.0:1783135448.016927:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783135448.016929:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121da00, rc 0) 00000100:00100000:1.0:1783135448.017370:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+7:9671:x1869752792270208:12345-192.168.201.60@tcp:101:touch.500 Request processed in 23889us (24097us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135448.017381:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:0.0:1783135448.025199:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135448.025260:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792270464 00000100:00100000:2.0:1783135448.025271:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792270464 00000100:00080000:0.0:1783135448.025342:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135448.025344:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:2.0:1783135448.025357:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+7:9671:x1869752792270464:12345-192.168.201.60@tcp:101:touch.500 00010000:00010000:2.0:1783135448.025377:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135448.025396:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dc2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.025938:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.025954:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.025975:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.025989:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.025997:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.026003:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135448.026962:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1783135448.027211:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ca69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027223:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ca69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027232:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ca69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027264:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027271:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027278:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027284:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135448.027293:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027301:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027313:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f10923f00) 00010000:00010000:2.0:1783135448.027316:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135448.027321:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027327:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135448.027339:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000042b6a6e3 reply state 00000000c9aaedd7 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135448.027347:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783135448.027380:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dc2 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027393:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ca69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dc2 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.027400:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8f18315e00) 00010000:00010000:2.0:1783135448.027412:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135448.027415:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2a00, rc 0) 00000100:00100000:2.0:1783135448.027486:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+10:9671:x1869752792270464:12345-192.168.201.60@tcp:101:touch.500 Request processed in 2132us (2297us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783135448.027494:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 22 00010000:00010000:3.0:1783135448.037256:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037275:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037282:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037303:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135448.037308:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037315:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037333:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8e8f18315f00) 00010000:00010000:3.0:1783135448.037335:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135448.037340:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037346:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875ca62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135448.037520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135448.037593:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792270720 00000100:00100000:3.0:1783135448.037604:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792270720 00000100:00100000:3.0:1783135448.037659:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:3.0:1783135448.037669:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+9:9671:x1869752792270720:12345-192.168.201.60@tcp:36:touch.500 00010000:00010000:3.0:1783135448.037733:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135448.037753:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ca69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dc2 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037763:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8f18315e00) 00010000:00010000:3.0:1783135448.037769:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135448.037812:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037857:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.037874:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135448.038147:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a60c3c2b reply state 00000000179ecd5a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135448.038157:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135448.038246:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+10:9671:x1869752792270720:12345-192.168.201.60@tcp:36:touch.500 Request processed in 578us (731us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783135448.038254:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:2.0:1783135448.041367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1783135448.041435:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.041447:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.041454:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.041477:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135448.041482:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.041489:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.041504:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8f08840700) 00010000:00010000:0.0:1783135448.041507:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135448.041511:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.041517:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875ca77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135448.041621:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792270848 00000100:00100000:3.0:1783135448.041629:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792270848 00000100:00100000:3.0:1783135448.041679:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:3.0:1783135448.041688:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+9:9671:x1869752792270848:12345-192.168.201.60@tcp:101:touch.500 00010000:00010000:3.0:1783135448.041711:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135448.041727:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875ca7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dc9 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.041781:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875ca7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dc9 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.041794:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875ca7e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dc9 expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.041847:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8f08840e00) 00010000:00010000:3.0:1783135448.042127:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135448.042130:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487a00, rc 0) 00000100:00100000:3.0:1783135448.042202:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+10:9671:x1869752792270848:12345-192.168.201.60@tcp:101:touch.500 Request processed in 514us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135448.042210:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:3.0:1783135448.052432:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135448.052543:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792270976 00000100:00100000:1.0:1783135448.052554:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792270976 00000100:00100000:1.0:1783135448.052618:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:1.0:1783135448.052627:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1869752792270976:12345-192.168.201.60@tcp:8:touch.500 00010000:00080000:1.0:1783135448.052661:0:6589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp t0 exp 0000000000000000 cur 347 last 0 00000020:00000080:1.0:1783135448.052696:0:6589:0:(genops.c:1406:class_connect()) connect: client 0c7819a6-778a-4617-af33-00460db74182, cookie 0xf646e0cda875ca85 00002000:00100000:1.0:1783135448.052708:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c7819a6-778a-4617-af33-00460db74182/ffff8e8f3bf68000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783135448.052720:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783135448.053017:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135448.053049:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8f04f3f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135448.053130:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2359:x1869752792270976:12345-192.168.201.60@tcp:8:touch.500 Request processed in 501us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135448.053138:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:1.0:1783135448.058486:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135448.058800:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792271104 00000100:00100000:2.0:1783135448.058810:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792271104 00000100:00100000:3.0:1783135448.066747:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:3.0:1783135448.066763:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:0:x1869752792271104:12345-192.168.201.60@tcp:2:touch.500 00000100:00080000:0.0:1783135448.067893:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1783135448.185079:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000001:00080000:2.0:1783135448.185108:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1783135448.185242:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+5:0:x1869752792271104:12345-192.168.201.60@tcp:2:touch.500 Request processed in 118476us (126760us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783135448.185254:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:0.0:1783135448.188391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135448.188698:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792271360 00000100:00100000:3.0:1783135448.188707:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792271360 00000100:00100000:3.0:1783135448.188771:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:3.0:1783135448.188781:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+10:9671:x1869752792271360:12345-192.168.201.60@tcp:35:touch.500 00000100:00100000:3.0:1783135448.189177:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+11:9671:x1869752792271360:12345-192.168.201.60@tcp:35:touch.500 Request processed in 396us (793us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783135448.189185:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:3.0:1783135448.206387:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135448.208180:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792271488 00000100:00100000:2.0:1783135448.208197:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792271488 00000100:00100000:2.0:1783135448.208275:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:2.0:1783135448.208287:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+11:9672:x1869752792271488:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:2.0:1783135448.208312:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135448.208334:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dd0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.208410:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.208424:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.208436:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135448.208533:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783135448.208537:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135448.208585:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.209151:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dd0 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.209173:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dd0 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.209198:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f10923f00) 00010000:00010000:2.0:1783135448.209201:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135448.209205:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2200, rc 0) 00000100:00100000:0.0:1783135448.210536:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+12:9672:x1869752792271488:12345-192.168.201.60@tcp:101:rm.0 Request processed in 2243us (4159us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135448.210546:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:1.0:1783135448.245123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135448.247256:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792271744 00000100:00100000:2.0:1783135448.247273:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792271744 00000100:00100000:2.0:1783135448.247359:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 26 00000100:00100000:2.0:1783135448.247369:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+12:9672:x1869752792271744:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:2.0:1783135448.247392:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135448.247413:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dd7 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135448.247530:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1783135448.247697:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca9a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dd7 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.247724:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840900) 00010000:00010000:2.0:1783135448.247727:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135448.247733:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ca9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dd7 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.247750:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3e00, rc 0) 00000100:00100000:2.0:1783135448.247877:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+13:9672:x1869752792271744:12345-192.168.201.60@tcp:101:rm.0 Request processed in 508us (2782us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1783135448.247885:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 26 00000100:00100000:2.0:1783135448.271470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135448.271556:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792271872 00000100:00100000:3.0:1783135448.271568:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792271872 00000100:00100000:3.0:1783135448.271751:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:3.0:1783135448.271763:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+13:9672:x1869752792271872:12345-192.168.201.60@tcp:37:rm.0 00000100:00100000:3.0:1783135448.285619:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+13:9672:x1869752792271872:12345-192.168.201.60@tcp:37:rm.0 Request processed in 13847us (14149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135448.285633:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:1.0:1783135448.306878:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135448.308385:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792272128 00000100:00100000:2.0:1783135448.308443:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792272128 00000100:00100000:2.0:1783135448.308537:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:2.0:1783135448.308553:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26325c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+13:9672:x1869752792272128:12345-192.168.201.60@tcp:35:rm.0 00000100:00100000:2.0:1783135448.309016:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26325c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+14:9672:x1869752792272128:12345-192.168.201.60@tcp:35:rm.0 Request processed in 465us (2209us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1783135448.309027:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:2.0:1783135448.315563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135448.315674:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792272384 00000100:00100000:1.0:1783135448.315691:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792272384 00000100:00100000:1.0:1783135448.315858:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 27 00000100:00100000:1.0:1783135448.315871:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+14:9672:x1869752792272384:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1783135448.315904:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135448.315930:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875caa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dde expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.316114:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875caaf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.316156:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875caaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.316172:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875caaf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135448.316187:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783135448.316378:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875caa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dde expref: 17 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.316401:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875caaf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dde expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.316412:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f10923f00) 00010000:00010000:1.0:1783135448.316415:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135448.316419:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c600, rc 0) 00000100:00100000:1.0:1783135448.316495:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+16:9672:x1869752792272384:12345-192.168.201.60@tcp:101:rm.0 Request processed in 627us (946us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783135448.316504:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 27 00000100:00100000:3.0:1783135448.319436:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135448.332654:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792272512 00000100:00100000:0.0:1783135448.332679:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792272512 00000100:00100000:0.0:1783135448.332805:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:0.0:1783135448.332835:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+16:9672:x1869752792272512:12345-192.168.201.60@tcp:41:rm.0 00000004:00000024:0.0:1783135448.332923:0:5794:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1783135448.333060:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+16:9672:x1869752792272512:12345-192.168.201.60@tcp:41:rm.0 Request processed in 243us (13638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135448.333069:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:2.0:1783135448.338494:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135448.340723:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792272640 00000100:00100000:1.0:1783135448.340748:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792272640 00000100:00100000:1.0:1783135448.341022:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:1.0:1783135448.341036:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+16:9672:x1869752792272640:12345-192.168.201.60@tcp:101:rm.0 00010000:00010000:1.0:1783135448.341066:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135448.341093:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875cabd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11de5 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341367:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341387:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341400:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341417:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341425:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341432:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341583:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cad2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341593:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341601:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135448.341638:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783135448.341643:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135448.341666:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341693:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cad2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341704:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341711:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341718:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341725:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121ca00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135448.341730:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341738:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341752:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f10923f00) 00010000:00010000:1.0:1783135448.341756:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135448.341762:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341769:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cac4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341785:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341791:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341804:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.341809:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135448.341812:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.342074:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.342084:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8e8f10923800) 00010000:00010000:1.0:1783135448.342087:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135448.342091:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.342108:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cacb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.342153:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875cabd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11de5 expref: 18 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.342170:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cad2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11de5 expref: 17 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.342178:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8f08840e00) 00010000:00010000:1.0:1783135448.342181:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135448.342184:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c200, rc 0) 00000100:00100000:1.0:1783135448.342384:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+17:9672:x1869752792272640:12345-192.168.201.60@tcp:101:rm.0 Request processed in 1349us (3903us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135448.342405:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:2.0:1783135448.348746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135448.348938:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792272896 00000100:00100000:0.0:1783135448.348953:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792272896 00000100:00100000:0.0:1783135448.349036:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 30 00000100:00100000:0.0:1783135448.349048:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+17:9672:x1869752792272896:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:0.0:1783135448.349144:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783135448.349183:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cad2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11de5 expref: 17 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349230:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875ca7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dc9 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349243:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8f08840e00) 00010000:00010000:0.0:1783135448.349263:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ca93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dd0 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349272:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f10923f00) 00010000:00010000:0.0:1783135448.349276:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135448.349302:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349317:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349328:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349364:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349372:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349378:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349537:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349546:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.349553:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135448.351753:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783135448.351775:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347780958988ns, next at 348780954285ns, rc = 0 00010000:00010000:0.0:1783135448.352004:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352024:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352035:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352045:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352069:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352075:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352271:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135448.352304:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352311:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352318:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352324:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135448.352329:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352337:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352351:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:0.0:1783135448.352354:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783135448.352359:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352364:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cae7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352387:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352401:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352408:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352413:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135448.352416:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352423:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352433:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f10923f00) 00010000:00010000:0.0:1783135448.352436:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135448.352439:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.352446:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cad9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135448.352458:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f6966cf4 reply state 000000009bdf09b6 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135448.352468:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135448.352603:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+16:9672:x1869752792272896:12345-192.168.201.60@tcp:36:rm.0 Request processed in 3550us (3867us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783135448.352614:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 30 00010000:00010000:1.0:1783135448.353207:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135448.353228:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.353237:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135448.353242:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.353250:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.353263:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135448.353266:0:6603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783135448.353269:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135448.353275:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875caee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.353371:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135448.353374:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135448.353376:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135448.358801:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.358865:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.358876:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.358885:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221a00 already unused, calling callback (ffffffffc21214f0) 00000100:00100000:3.0:1783135448.358890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:2.0:1783135448.358894:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.358906:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.358931:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xe219b27a (ffff8e8f180c6e00) 00010000:00010000:2.0:1783135448.358936:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135448.358943:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135448.358962:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221a00/0xf646e0cda875cae0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xe219b27a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135448.359084:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792273152 00000100:00100000:0.0:1783135448.359109:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792273152 00000100:00100000:0.0:1783135448.359197:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:0.0:1783135448.359211:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+15:9672:x1869752792273152:12345-192.168.201.60@tcp:35:rm.0 00000100:00100000:0.0:1783135448.359643:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+16:9672:x1869752792273152:12345-192.168.201.60@tcp:35:rm.0 Request processed in 433us (763us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783135448.359654:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:2.0:1783135448.366992:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135448.368134:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792273408 00000100:00100000:3.0:1783135448.368154:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792273408 00000100:00100000:3.0:1783135448.368256:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 31 00000100:00100000:3.0:1783135448.368271:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+16:9672:x1869752792273408:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:3.0:1783135448.368361:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783135448.368407:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875caaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dde expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.368437:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875ca4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dbb expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.368451:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f10923f00) 00010000:00010000:3.0:1783135448.368469:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487000/0xf646e0cda875ca0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dad expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.368479:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840900) 00010000:00010000:3.0:1783135448.368489:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135448.369078:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.369116:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.369131:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.369154:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.369162:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.369199:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.371059:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.371105:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.371126:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135448.382643:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1783135448.382701:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.382715:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.382724:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.382731:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135448.382737:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.382971:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.382995:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8e8f08840c00) 00010000:00010000:3.0:1783135448.382998:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1783135448.383023:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.383031:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487600/0xf646e0cda875cb03 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.383076:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.383102:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.383108:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.383476:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135448.383480:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.383487:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.383498:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840f00) 00010000:00010000:3.0:1783135448.383500:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135448.383503:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135448.383509:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486e00/0xf646e0cda875caf5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135448.383985:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000082b7afaa reply state 0000000054653acd transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135448.384018:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135448.384664:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+15:9672:x1869752792273408:12345-192.168.201.60@tcp:36:rm.0 Request processed in 16389us (17680us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1783135448.384675:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 31 00010000:00010000:0.0:1783135448.390334:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.390364:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.390376:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.390384:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135448.390391:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.390416:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.390444:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8e8f08840300) 00010000:00010000:0.0:1783135448.390449:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135448.390455:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135448.390463:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875cafc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135449.021011:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135449.210891:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813278592:0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.210971:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135449.211033:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135449.211039:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813278464:0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.211064:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135449.211113:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813278592 00000100:00100000:1.0:1783135449.211122:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813278592 00000100:00100000:1.0:1783135449.211176:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783135449.211184:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813278592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.211244:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813278592:12345-0@lo:400:kworker.0 Request processed in 60us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135449.211251:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1783135449.211271:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1783135449.211296:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bfaa00 x1869752813278592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135449.211311:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813278592:0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.211348:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813278464 00000100:00100000:1.0:1783135449.211352:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813278464 00000100:00100000:1.0:1783135449.211387:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783135449.211397:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813278464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135449.211399:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813278208:0@lo:400:kworker.0 00000100:00100000:2.0:1783135449.211486:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135449.211549:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813278720:0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.211552:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813278464:12345-0@lo:400:kworker.0 Request processed in 156us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135449.211565:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783135449.211600:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813278208 00000100:00100000:2.0:1783135449.211607:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135449.211608:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813278208 00000100:00100000:1.0:1783135449.211646:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1783135449.211648:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135449.211657:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813278208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135449.211662:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813278336:0@lo:400:kworker.0 00000100:00100000:2.0:1783135449.211695:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135449.211727:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813278848:0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.211737:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813278208:12345-0@lo:400:kworker.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135449.211747:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1783135449.211767:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783135449.211790:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135449.211856:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813278464:0@lo:400:kworker.0 00000100:00100000:2.0:1783135449.211874:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813278208:0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.211889:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813278720 00000100:00100000:1.0:1783135449.211895:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813278720 00000100:00080000:1.0:1783135449.211922:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135449.211923:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813278848 00000100:00100000:2.0:1783135449.211930:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813278848 00000100:00100000:1.0:1783135449.211970:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813278336 00000100:00100000:1.0:1783135449.211976:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813278336 00000100:00100000:2.0:1783135449.212013:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783135449.212021:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783135449.212033:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813278848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.212042:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813278720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.212126:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813278720:12345-0@lo:400:kworker.0 Request processed in 95us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135449.212133:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783135449.212144:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1783135449.212150:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813278336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135449.212185:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813278336:12345-0@lo:400:kworker.0 Request processed in 35us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135449.212192:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783135449.212233:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813278848:12345-0@lo:400:kworker.0 Request processed in 194us (455us total) trans 0 rc 0/0 00000100:00080000:1.0:1783135449.212238:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135449.212247:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135449.212298:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813278336:0@lo:400:kworker.0 00010000:00080000:2.0:1783135449.212311:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37bf9500 x1869752813278848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135449.212335:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813278848:0@lo:400:kworker.0 00000100:00100000:2.0:1783135449.212348:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813278720:0@lo:400:kworker.0 00000100:00100000:2.0:1783135449.726457:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135449.726484:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813278976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135449.726563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135449.726643:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813278976 00000100:00100000:2.0:1783135449.726652:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813278976 00000100:00100000:2.0:1783135449.726703:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783135449.726712:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813278976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135449.726751:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135449.726800:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813278976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135449.726807:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1783135449.726863:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f10b5df80 x1869752813278976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135449.726880:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813278976:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783135450.047238:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135451.069215:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135451.137247:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135451.137314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135451.137346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135451.137398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135451.137415:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792273664 00000100:00100000:1.0:1783135451.137446:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792273664 00000100:00100000:1.0:1783135451.137559:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792273920 00000100:00100000:1.0:1783135451.137563:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792273920 00000100:00100000:1.0:1783135451.137592:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 104 00000100:00100000:1.0:1783135451.137603:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+14:2362:x1869752792273664:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135451.137747:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+14:2362:x1869752792273664:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 145us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135451.137758:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 104 00000100:00100000:0.0:1783135451.137773:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792273536 00000100:00100000:0.0:1783135451.137791:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792273536 00000100:00100000:0.0:1783135451.137872:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 248 00000100:00100000:0.0:1783135451.137883:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792273536:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135451.137954:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792273536:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 74us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135451.137962:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 248 00000100:00100000:0.0:1783135451.138033:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 105 00000100:00100000:0.0:1783135451.138042:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792273920:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135451.138090:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792273920:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 49us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135451.138171:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 105 00000100:00100000:0.0:1783135451.138213:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792273792 00000100:00100000:0.0:1783135451.138218:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792273792 00000100:00100000:0.0:1783135451.138261:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 58 00000100:00100000:0.0:1783135451.138269:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792273792:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135451.138667:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792273792:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 396us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135451.138675:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 58 00000100:00080000:2.0:1783135451.138808:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135451.138856:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1783135451.771717:0:6700:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351200897940ns, next at 352200895107ns, rc = 0 00000100:00100000:3.0:1783135451.771784:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135451.771808:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813279104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135451.771926:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135451.772274:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813279104 00000100:00100000:0.0:1783135451.772284:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813279104 00000100:00100000:0.0:1783135451.772368:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135451.772377:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813279104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135451.772411:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783135451.772888:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135451.773270:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813279104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 891us (1341us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135451.773305:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1783135451.774049:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c8bce00 x1869752813279104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135467 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135451.774074:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813279104:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783135452.090993:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135453.114962:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783135453.369449:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1783135453.369497:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1783135453.369510:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:2.0:1783135453.369573:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:1.0:1783135453.369759:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135453.369798:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813279232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783135453.369937:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135453.370508:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813279232 00000100:00100000:1.0:1783135453.370519:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813279232 00000100:00100000:1.0:1783135453.370625:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1783135453.370630:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135453.370652:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813279232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783135453.370703:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1783135453.370754:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a487cd7, atime: 0x6a487cd7, ctime: 0x6a487cd7, blocks: 0x1 00010000:00010000:1.0:1783135453.370765:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135453.370785:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=352s v=(0 0) 00010000:00010000:1.0:1783135453.370791:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135453.370799:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135453.370866:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135453.370880:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135453.370889:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135453.370913:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135453.371442:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135453.371453:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135453.371464:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121da00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135453.371470:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135453.371481:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135453.371507:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135453.371515:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000955e5e26/0xf646e0cda875cb0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135453.371542:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135453.371544:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135453.371546:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135453.372291:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813279232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1652us (2355us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783135453.372302:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1783135453.375515:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f3d857100/2, rc 0, transno 4294967300 00000100:00100000:0.0:1783135453.375539:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d857100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813279232:0@lo:6:osp-syn-0-0.0 00000001:02000400:3.0:1783135453.396206:0:11471:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:0.0:1783135454.138312:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135454.330259:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813279360:0@lo:400:kworker.0 00000100:00100000:3.0:1783135454.330289:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813279616:0@lo:400:kworker.0 00000100:00100000:1.0:1783135454.330358:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813279488:0@lo:400:kworker.0 00000100:00100000:2.0:1783135454.330459:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813279744:0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.331965:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135454.332186:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813279872:0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.332237:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135454.332324:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813279360 00000100:00100000:0.0:1783135454.332335:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813279360 00000100:00100000:0.0:1783135454.332392:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783135454.332403:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813279360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.332471:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813279360:12345-0@lo:400:kworker.0 Request processed in 69us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135454.332479:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1783135454.332518:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813279872 00000100:00100000:0.0:1783135454.332522:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813279872 00000100:00100000:0.0:1783135454.332565:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783135454.332572:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813279872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.332605:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813279872:12345-0@lo:400:kworker.0 Request processed in 35us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135454.332612:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:0.0:1783135454.332633:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135454.332728:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813279872:0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.332739:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813279360:0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.337974:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135454.338070:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813280000:0@lo:400:kworker.0 00000100:00100000:1.0:1783135454.338897:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813279488 00000100:00100000:1.0:1783135454.338930:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813279488 00000100:00100000:0.0:1783135454.338967:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135454.339009:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135454.339018:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813280000 00000100:00100000:1.0:1783135454.339022:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813279488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.339022:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813280000 00000100:00100000:0.0:1783135454.339062:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783135454.339068:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813280000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135454.339093:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813279488:12345-0@lo:400:kworker.0 Request processed in 73us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135454.339110:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135454.339120:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813280000:12345-0@lo:400:kworker.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135454.339126:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1783135454.339152:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783135454.339193:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37c5a680 x1869752813280000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135454.339211:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813280000:0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.339251:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813279488:0@lo:400:kworker.0 00000100:00100000:3.0:1783135454.340764:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135454.345983:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813279616 00000100:00100000:0.0:1783135454.346031:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813279616 00000100:00100000:0.0:1783135454.346137:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783135454.346151:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813279616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135454.346327:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813279616:12345-0@lo:400:kworker.0 Request processed in 179us (5570us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135454.346336:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783135454.346407:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813279616:0@lo:400:kworker.0 00000100:00080000:0.0:1783135454.346456:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135454.353246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135454.353341:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813279744 00000100:00100000:1.0:1783135454.353354:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813279744 00000100:00100000:1.0:1783135454.353432:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783135454.353445:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813279744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135454.353527:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d856300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813279744:12345-0@lo:400:kworker.0 Request processed in 85us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135454.353537:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783135454.353690:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813279744:0@lo:400:kworker.0 00000020:00000080:1.0:1783135454.523650:0:11519:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdca07f180 20000000:00000080:1.0:1783135454.523678:0:11519:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8f056e8c00 uarg=0000000000000000 20000000:01000000:1.0:1783135454.523741:0:11519:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1783135454.523749:0:11519:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1783135454.523755:0:11519:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1783135454.525318:0:11520:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1783135454.528133:0:11519:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1783135454.537704:0:11519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1783135454.537758:0:11519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1783135454.537806:0:11519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1783135454.537859:0:11519:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783135454.537881:0:11519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.537901:0:11519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.537921:0:11519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.537929:0:11519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.537936:0:11519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.537942:0:11519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.537950:0:11519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.538568:0:11519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.538585:0:11519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 18 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135454.538599:0:11519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280128:0@lo:104: 00000100:00100000:1.0:1783135454.538664:0:11519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135454.538722:0:11519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.538730:0:11519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 18 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135454.538752:0:11519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37bfb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280256:0@lo:104: 00000100:00100000:1.0:1783135454.538774:0:11519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135454.538799:0:11519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.538806:0:11519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 18 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135454.538833:0:11519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280384:0@lo:104: 00000100:00100000:1.0:1783135454.538857:0:11519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783135454.539588:0:11519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 12 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.539604:0:11519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 12 pid: 5788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135454.539616:0:11519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280512:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135454.539680:0:11519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 12 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.539689:0:11519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 12 pid: 5789 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135454.539697:0:11519:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280640:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135454.539721:0:11519:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135454.542846:0:5778:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783135454.542880:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813280128 00000100:00100000:2.0:1783135454.542891:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813280128 00000100:00100000:2.0:1783135454.542945:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813280256 00000100:00100000:2.0:1783135454.542948:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813280256 00000100:00100000:2.0:1783135454.542957:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813280384 00000100:00100000:2.0:1783135454.542959:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813280384 00000100:00100000:2.0:1783135454.542979:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135454.543002:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:11519:x1869752813280128:12345-0@lo:104: 00010000:00010000:2.0:1783135454.543026:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543132:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135454.543139:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+5:11519:x1869752813280128:12345-0@lo:104: Request processed in 150us (4475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135454.543146:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783135454.543167:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135454.543172:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:11519:x1869752813280256:12345-0@lo:104: 00010000:00010000:2.0:1783135454.543179:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543233:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783135454.543308:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+4:11519:x1869752813280256:12345-0@lo:104: Request processed in 66us (4463us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135454.543316:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135454.543329:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135454.543335:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d12f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:11519:x1869752813280384:12345-0@lo:104: 00010000:00010000:2.0:1783135454.543342:0:5778:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543374:0:5778:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783135454.543378:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d12f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+3:11519:x1869752813280384:12345-0@lo:104: Request processed in 45us (4521us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135454.543384:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:2.0:1783135454.543564:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783135454.543572:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543580:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221400 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135454.543585:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543595:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135454.543603:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135454.543608:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135454.543655:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543662:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135454.543685:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543693:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05221400/0xf646e0cda875c9d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9dd expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543707:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135454.543710:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543715:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f00031e00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135454.543719:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543725:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135454.543731:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135454.543736:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135454.543745:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543749:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135454.543762:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543777:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f00031e00/0xf646e0cda875c9c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9cf expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543788:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135454.543790:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543796:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f00031600 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135454.543799:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543806:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135454.543812:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135454.543838:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135454.543849:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543854:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135454.543859:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543867:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f00031600/0xf646e0cda875c9ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875c9c1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.543879:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135454.543885:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135454.543887:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135454.543894:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135454.543900:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135454.543916:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813280768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135454.543956:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135454.544023:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813280896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135454.544051:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135454.544070:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135454.544075:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813281024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135454.544098:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135454.544127:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813280768 00000100:00100000:2.0:1783135454.544133:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813280768 00010000:00010000:2.0:1783135454.544156:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 19 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135454.544180:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813280896 00000100:00100000:2.0:1783135454.544183:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813280896 00010000:00010000:2.0:1783135454.544196:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 20 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135454.544208:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813281024 00000100:00100000:2.0:1783135454.544211:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813281024 00010000:00010000:2.0:1783135454.544219:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 21 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135454.544233:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783135454.548311:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783135454.548346:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+21:3311:x1869752813280896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135454.548376:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135454.548391:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 21 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135454.549018:0:5781:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783135454.549036:0:5781:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1783135454.549068:0:5782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783135454.549083:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135454.549097:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c89450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+21:3311:x1869752813281024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135454.549111:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135454.549119:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 21 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135454.549217:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 21 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135454.549454:0:11519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280128:0@lo:104: 00000100:00100000:1.0:1783135454.549471:0:11519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37bfb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280256:0@lo:104: 00000100:00100000:1.0:1783135454.549501:0:11519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280384:0@lo:104: 00000100:00100000:2.0:1783135454.551755:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+21:3314:x1869752813280768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135454.551788:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135454.551833:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 21 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135454.556117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135454.556139:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135454.556189:0:11519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280512:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135454.556201:0:11519:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11519:1869752813280640:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135454.556337:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 21 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135454.556374:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c486600/0xf646e0cda875c9c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c9ba expref: 21 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135454.556395:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135454.558032:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c89450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+20:3311:x1869752813281024:12345-0@lo:103:ldlm_bl.0 Request processed in 8927us (13920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135454.558048:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783135454.558104:0:5782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783135454.558119:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792274048 00000100:00100000:0.0:1783135454.558129:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792274048 00010000:00010000:0.0:1783135454.558169:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 13 pid: 5788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135454.558201:0:5782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783135454.558209:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792274176 00000100:00100000:0.0:1783135454.558212:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792274176 00010000:00010000:0.0:1783135454.558225:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 14 pid: 5789 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135454.558237:0:5782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783135454.558245:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:0.0:1783135454.558255:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+14:2360:x1869752792274048:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135454.558273:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135454.558279:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 14 pid: 5788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135454.558316:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 14 pid: 5788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135454.558334:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05221000/0xf646e0cda875c9b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d9f expref: 14 pid: 5788 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135454.558351:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135454.558417:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2360:x1869752792274048:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 164us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135454.558424:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:0.0:1783135454.558437:0:5782:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1783135454.558442:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 34 00000100:00100000:0.0:1783135454.558448:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:2363:x1869752792274176:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135454.558540:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135454.558545:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 12 pid: 5789 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135454.558554:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 12 pid: 5789 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135454.558564:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875c9ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d98 expref: 12 pid: 5789 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135454.558574:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135454.558592:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:2363:x1869752792274176:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 144us (2453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135454.558599:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 34 00010000:00010000:3.0:1783135454.563139:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875c9cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c9c8 expref: 19 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135454.563545:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135454.564100:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d854000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813281024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135454.564419:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d856a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:3311:x1869752813280896:12345-0@lo:103:ldlm_bl.0 Request processed in 16090us (20364us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135454.564432:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135454.567157:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813280896:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135454.567726:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 17 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567760:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c486a00/0xf646e0cda875c9dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875c9d6 expref: 17 pid: 5788 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567788:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567798:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567856:0:5780:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567864:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567871:0:5780:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567878:0:5780:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567885:0:5780:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121cc00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135454.567891:0:5780:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567900:0:5780:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567930:0:5780:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135454.567943:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135454.568069:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d857800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3314:x1869752813280768:12345-0@lo:103:ldlm_bl.0 Request processed in 23828us (24111us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135454.568082:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135454.568361:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813280768:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135454.570007:0:11519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.570059:0:11519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.570067:0:11519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135454.570074:0:11519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb11 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135454.842936:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135454.842963:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813281152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135454.843051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135454.843129:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813281152 00000100:00100000:3.0:1783135454.843137:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813281152 00000100:00100000:3.0:1783135454.843191:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135454.843202:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813281152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135454.843242:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135454.843293:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813281152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135454.843301:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1783135454.843605:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37c5a680 x1869752813281152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135454.843628:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813281152:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783135455.163394:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783135456.058478:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135456.058486:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8e0182b800 from 7 10000000:01000000:0.0:1783135456.058492:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135456.058568:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135456.058582:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135456.058594:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135456.058627:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813281280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135456.058711:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135456.058753:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813281280 00000100:00100000:1.0:1783135456.058762:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813281280 00000100:00100000:0.0:1783135456.058792:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135456.058831:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1783135456.058843:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:5791:x1869752813281280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135456.058857:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135456.058871:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875cb18 expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135456.058896:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875cb18 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135456.058907:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875cb18 expref: 17 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135456.058930:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121cc00, rc 0) 00000100:00100000:1.0:1783135456.058985:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813281280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135456.058996:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1783135456.060909:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813281280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135456.060936:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135456.060949:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135456.061039:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813281408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135456.061095:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135456.061185:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783135456.061186:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813281408 00000100:00100000:2.0:1783135456.061195:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813281408 00000100:00100000:2.0:1783135456.062937:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1783135456.062957:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813281408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135456.063272:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813281408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135456.063280:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1783135456.063395:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813281408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135456.063458:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813281536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135456.063505:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135456.063725:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203b40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135456.063889:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813281536 00000100:00100000:1.0:1783135456.063895:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813281536 00000100:00100000:1.0:1783135456.063942:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1783135456.063950:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813281536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135456.064124:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813281536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135456.064132:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1783135456.064178:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813281536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.064630:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11533:1869752813281664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135456.064673:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135456.064693:0:11533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0f180 going to sleep for 11 seconds 00000100:00100000:1.0:1783135456.064846:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813281664 00000100:00100000:1.0:1783135456.064851:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813281664 00000100:00100000:1.0:1783135456.064876:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1783135456.064884:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:11533:x1869752813281664:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135456.065199:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:11533:x1869752813281664:12345-0@lo:502:llog_process_th.0 Request processed in 314us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135456.065207:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1783135456.065548:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11533:1869752813281664:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135456.065588:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135456.065599:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135456.065602:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135456.065609:0:11533:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8e0182b800 00000020:00000080:3.0:1783135456.065611:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135456.065694:0:11533:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11533:1869752813281792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135456.065732:0:11533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135456.065763:0:11533:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02458f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135456.067063:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813281792 00000100:00100000:2.0:1783135456.067074:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813281792 00000100:00100000:2.0:1783135456.067160:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1783135456.067172:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:11533:x1869752813281792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783135456.067446:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:11533:x1869752813281792:12345-0@lo:502:llog_process_th.0 Request processed in 274us (1712us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135456.067454:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1783135456.068746:0:11533:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11533:1869752813281792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135456.068785:0:11533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135456.068794:0:11533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135456.068796:0:11533:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783135456.068801:0:11533:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783135456.069054:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783135456.069073:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135456.069085:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135456.069110:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135456.069122:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135456.069124:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f04f38800 from 7 10000000:01000000:2.0:1783135456.069127:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135456.069159:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135456.069167:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135456.069177:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135456.069199:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d856a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813281920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135456.069276:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135456.069349:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135456.071093:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813281920 00000100:00100000:3.0:1783135456.071107:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813281920 00000100:00100000:3.0:1783135456.071168:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1783135456.071180:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:5791:x1869752813281920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135456.071198:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135456.071215:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875cb2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875cb26 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.071585:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875cb2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875cb26 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.071598:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875cb2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875cb26 expref: 18 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.071609:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486000, rc 0) 00000100:00100000:3.0:1783135456.071757:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813281920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 578us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.071765:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1783135456.073737:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d856a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813281920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135456.073768:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135456.073782:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135456.073899:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d856a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135456.073980:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135456.074127:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf73b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135456.074598:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813282048 00000100:00100000:0.0:1783135456.074605:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813282048 00000100:00100000:0.0:1783135456.074689:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1783135456.074701:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813282048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135456.075198:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813282048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 498us (1217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135456.075206:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1783135456.075304:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d856a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135456.075345:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d856a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135456.075390:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135456.082499:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf73b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135456.086443:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813282176 00000100:00100000:3.0:1783135456.086459:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813282176 00000100:00100000:3.0:1783135456.086517:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783135456.086529:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813282176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.086783:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813282176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (11392us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.086792:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1783135456.086881:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d856a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.087095:0:11536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11536:1869752813282304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135456.087141:0:11536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135456.087163:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813282304 00000100:00100000:3.0:1783135456.087167:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813282304 00000100:00100000:3.0:1783135456.087186:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783135456.087192:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:11536:x1869752813282304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135456.087530:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:11536:x1869752813282304:12345-0@lo:502:llog_process_th.0 Request processed in 336us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.087538:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1783135456.087587:0:11536:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135456.087601:0:11536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11536:1869752813282304:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135456.087627:0:11536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135456.087637:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135456.087639:0:11536:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135456.087647:0:11536:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8f04f38800 00000020:00000080:3.0:1783135456.087658:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135456.087743:0:11536:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11536:1869752813282432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135456.087780:0:11536:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135456.087801:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813282432 00000100:00100000:3.0:1783135456.087804:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813282432 00000100:00100000:3.0:1783135456.087854:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783135456.087861:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:11536:x1869752813282432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135456.088000:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:11536:x1869752813282432:12345-0@lo:502:llog_process_th.0 Request processed in 139us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.088007:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783135456.088035:0:11536:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135456.088047:0:11536:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11536:1869752813282432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135456.088064:0:11536:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135456.088069:0:11536:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135456.088070:0:11536:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783135456.088073:0:11536:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783135456.088126:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783135456.088146:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135456.088155:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.088165:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135456.088174:0:5791:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783135456.088177:0:5791:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f063e9800 from 7 10000000:01000000:3.0:1783135456.088180:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783135456.088205:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.088226:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.088656:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135456.088673:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.088710:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135456.088729:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135456.088744:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813282560 00000100:00100000:3.0:1783135456.088748:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813282560 00000100:00100000:3.0:1783135456.088777:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783135456.088785:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:5791:x1869752813282560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135456.088795:0:5789:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135456.088808:0:5789:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487600/0xf646e0cda875cb3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875cb34 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.088851:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487600/0xf646e0cda875cb3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875cb34 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.088863:0:5789:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c487600/0xf646e0cda875cb3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875cb34 expref: 19 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.088871:0:5789:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487600, rc 0) 00000100:00100000:3.0:1783135456.088902:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813282560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.088908:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783135456.088954:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135456.088978:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.088986:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135456.089026:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.089049:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135456.089061:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135456.089072:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813282688 00000100:00100000:3.0:1783135456.089074:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813282688 00000100:00100000:3.0:1783135456.089090:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783135456.089095:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813282688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.089493:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813282688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 396us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.089500:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1783135456.089531:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.089556:0:5791:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.089588:0:5791:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135456.089600:0:5791:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8840 going to sleep for 11 seconds 00000100:00100000:3.0:1783135456.089610:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813282816 00000100:00100000:3.0:1783135456.089614:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813282816 00000100:00100000:3.0:1783135456.089632:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783135456.089637:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813282816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.089753:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:5791:x1869752813282816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.089765:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1783135456.089801:0:5791:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:5791:1869752813282816:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783135456.105807:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783135456.107283:0:11537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11537:1869752813282944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135456.107367:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135456.107416:0:11537:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135456.107467:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813282944 00000100:00100000:0.0:1783135456.107475:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813282944 00000100:00100000:0.0:1783135456.108186:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783135456.108199:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:11537:x1869752813282944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135456.108464:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:11537:x1869752813282944:12345-0@lo:502:llog_process_th.0 Request processed in 267us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135456.108472:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1783135456.109029:0:11537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11537:1869752813282944:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135456.109072:0:11537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135456.109083:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135456.109086:0:11537:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783135456.109094:0:11537:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8f063e9800 00000020:00000080:0.0:1783135456.109098:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783135456.109183:0:11537:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11537:1869752813283072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135456.109239:0:11537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135456.109274:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813283072 00000100:00100000:0.0:1783135456.109281:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813283072 00000100:00100000:0.0:1783135456.109314:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783135456.109321:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:11537:x1869752813283072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135456.109466:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:11537:x1869752813283072:12345-0@lo:502:llog_process_th.0 Request processed in 144us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135456.109473:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783135456.109598:0:11537:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04ee0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783135456.109613:0:11537:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:11537:1869752813283072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783135456.109632:0:11537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135456.109638:0:11537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135456.109639:0:11537:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783135456.109643:0:11537:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783135456.109709:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1783135456.109732:0:5791:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135456.109741:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135456.109752:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135456.187316:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135456.255615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.255664:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.255797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.255864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.255893:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792274560 00000100:00100000:3.0:1783135456.255903:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792274560 00000100:00100000:3.0:1783135456.255978:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:3.0:1783135456.255989:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792274560:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135456.256108:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792274560:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 120us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.256116:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:3.0:1783135456.256140:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792274432 00000100:00100000:3.0:1783135456.256143:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792274432 00000100:00100000:3.0:1783135456.256170:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792274688 00000100:00100000:3.0:1783135456.256173:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792274688 00000100:00100000:3.0:1783135456.256194:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 109 00000100:00100000:3.0:1783135456.256201:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792274432:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135456.256232:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792274432:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 32us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.256239:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 109 00000100:00100000:3.0:1783135456.256250:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 110 00000100:00100000:3.0:1783135456.256257:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792274688:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135456.256280:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792274688:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 24us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.256300:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 110 00000100:00080000:3.0:1783135456.256318:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135456.256322:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135456.256698:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792274304 00000100:00100000:0.0:1783135456.256704:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792274304 00000100:00100000:0.0:1783135456.256740:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 265 00000100:00100000:0.0:1783135456.256746:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:2363:x1869752792274304:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135456.256780:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:2363:x1869752792274304:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 35us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135456.256793:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 265 00000100:00100000:3.0:1783135456.502312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135456.502415:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792274816 00000100:00100000:0.0:1783135456.502430:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792274816 00000100:00100000:0.0:1783135456.502523:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 266 00000100:00100000:0.0:1783135456.502537:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:5578:x1869752792274816:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135456.502557:0:5787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135456.502576:0:5787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f05221a00/0xf646e0cda875cb42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dec expref: -99 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135456.502607:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f05221a00/0xf646e0cda875cb42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dec expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135456.502619:0:5787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f05221a00/0xf646e0cda875cb42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dec expref: 12 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135456.502629:0:5787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05221a00, rc 0) 00000100:00100000:0.0:1783135456.502734:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792274816:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 Request processed in 200us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135456.502742:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 266 00000100:00100000:0.0:1783135456.507169:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.512223:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792274944 00000100:00100000:3.0:1783135456.512245:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792274944 00000100:00100000:3.0:1783135456.512653:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 267 00000100:00100000:3.0:1783135456.512668:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792274944:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.513185:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792274944:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 Request processed in 518us (6028us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.513195:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 267 00000100:00100000:1.0:1783135456.526795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.530210:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792275072 00000100:00100000:3.0:1783135456.530232:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792275072 00000100:00100000:3.0:1783135456.531078:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 268 00000100:00100000:3.0:1783135456.531095:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792275072:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135456.532252:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792275072:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 Request processed in 1149us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.532449:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 268 00000100:00100000:2.0:1783135456.542153:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.542353:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792275200 00000100:00100000:3.0:1783135456.542369:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792275200 00000100:00100000:3.0:1783135456.542497:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 269 00000100:00100000:3.0:1783135456.542511:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:9942:x1869752792275200:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135456.542900:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:9942:x1869752792275200:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 390us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.542911:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 269 00000100:00100000:1.0:1783135456.557213:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.557509:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792275328 00000100:00100000:3.0:1783135456.557522:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792275328 00000100:00100000:3.0:1783135456.557601:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 270 00000100:00100000:3.0:1783135456.557614:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:9942:x1869752792275328:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135456.558033:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:9942:x1869752792275328:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 420us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.558055:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 270 00000100:00100000:2.0:1783135456.569226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135456.569548:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792275456 00000100:00100000:3.0:1783135456.569564:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792275456 00000100:00100000:3.0:1783135456.569647:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 271 00000100:00100000:3.0:1783135456.569660:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:5578:x1869752792275456:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135456.569684:0:5788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135456.569710:0:5788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487000/0xf646e0cda875cb49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11df3 expref: -99 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.569764:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487000/0xf646e0cda875cb49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11df3 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.569778:0:5788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c487000/0xf646e0cda875cb49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11df3 expref: 13 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135456.569789:0:5788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487000, rc 0) 00000100:00100000:3.0:1783135456.569930:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792275456:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 Request processed in 272us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135456.569938:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 271 00000100:00100000:0.0:1783135456.579601:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135456.579725:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792275584 00000100:00100000:1.0:1783135456.579756:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792275584 00000100:00100000:1.0:1783135456.579869:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 272 00000100:00100000:1.0:1783135456.579882:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792275584:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135456.581025:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792275584:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 Request processed in 1136us (1429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135456.581038:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 272 00000100:00100000:1.0:1783135456.590491:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135456.597422:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792275712 00000100:00100000:0.0:1783135456.597452:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792275712 00000100:00100000:2.0:1783135456.598603:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 273 00000100:00100000:2.0:1783135456.598619:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792275712:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783135456.599006:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:5578:x1869752792275712:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 Request processed in 389us (8533us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135456.599016:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 273 00000100:00100000:1.0:1783135456.612567:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135456.616574:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792275840 00000100:00100000:2.0:1783135456.616607:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792275840 00000100:00100000:2.0:1783135456.616729:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 274 00000100:00100000:2.0:1783135456.616742:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:9945:x1869752792275840:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135456.617501:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:9945:x1869752792275840:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 754us (4945us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135456.617513:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 274 00000100:00100000:0.0:1783135456.633133:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135456.633389:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792275968 00000100:00100000:2.0:1783135456.633402:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792275968 00000100:00100000:2.0:1783135456.633503:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 275 00000100:00100000:2.0:1783135456.633515:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:9945:x1869752792275968:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135456.634301:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:9945:x1869752792275968:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 719us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135456.634316:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 275 00000100:00100000:3.0:1783135456.890335:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813283200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135456.890429:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135456.890685:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813283200 00000100:00100000:1.0:1783135456.890770:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813283200 00000100:00100000:1.0:1783135456.890938:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135456.890961:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869752813283200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135456.891013:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135456.891082:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3314:x1869752813283200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135456.891090:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783135456.891184:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813283200:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783135456.891804:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1783135457.146683:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135457.213509:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135458.239162:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783135458.501685:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1783135459.258349:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135459.455984:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813283712:0@lo:400:kworker.0 00000100:00100000:3.0:1783135459.456105:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135459.456122:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813283456:0@lo:400:kworker.0 00000100:00100000:3.0:1783135459.456199:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135459.456210:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813283584:0@lo:400:kworker.0 00000100:00100000:2.0:1783135459.456241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135459.456292:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813283456 00000100:00100000:3.0:1783135459.456304:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813283456 00000100:00100000:2.0:1783135459.456305:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813283968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135459.456356:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135459.456392:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783135459.456408:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813283456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135459.456421:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783135459.456432:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813283328:0@lo:400:kworker.0 00000100:00100000:0.0:1783135459.456579:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813283712 00000100:00100000:0.0:1783135459.456585:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813283712 00000100:00100000:0.0:1783135459.456624:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813283968 00000100:00100000:0.0:1783135459.456637:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813283968 00000100:00100000:1.0:1783135459.456708:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135459.456720:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813283712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135459.456772:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135459.456781:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813283968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135459.457552:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d857800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813283456:12345-0@lo:400:kworker.0 Request processed in 1146us (1314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135459.457562:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1783135459.457604:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135459.457645:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135459.457650:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135459.457668:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813283584 00000100:00100000:3.0:1783135459.457673:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813283584 00000100:00100000:3.0:1783135459.459977:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1783135459.459998:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813283584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135459.460120:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813283584:12345-0@lo:400:kworker.0 Request processed in 130us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135459.460128:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1783135459.460169:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135459.460216:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813283584:0@lo:400:kworker.0 00000100:00100000:2.0:1783135459.460689:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135459.461326:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813283840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135459.461465:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135459.461520:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813283456:0@lo:400:kworker.0 00000100:00100000:2.0:1783135459.461575:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813283840 00000100:00100000:2.0:1783135459.461581:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813283840 00000100:00100000:2.0:1783135459.461637:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135459.461647:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813283840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135459.461701:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813283840:12345-0@lo:400:kworker.0 Request processed in 55us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135459.461723:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1783135459.462502:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813283840:0@lo:400:kworker.0 00000100:00100000:3.0:1783135459.470208:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813283328 00000100:00100000:3.0:1783135459.470229:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813283328 00000100:00100000:3.0:1783135459.470331:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1783135459.470346:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813283328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135459.470536:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813283328:12345-0@lo:400:kworker.0 Request processed in 193us (9853us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135459.470545:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00080000:3.0:1783135459.470600:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135459.470653:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813283328:0@lo:400:kworker.0 00000100:00100000:1.0:1783135459.476432:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813283712:12345-0@lo:400:kworker.0 Request processed in 19698us (20312us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135459.476455:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783135459.476529:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1783135459.476542:0:3314:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f3d857100, transno 4294967300 00000100:00100000:3.0:1783135459.476575:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813283712:0@lo:400:kworker.0 00000100:00100000:0.0:1783135459.476934:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813283968:12345-0@lo:400:kworker.0 Request processed in 20150us (20574us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135459.476946:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:3.0:1783135459.477127:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37b82a00 x1869752813283968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135459.477145:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813283968:0@lo:400:kworker.0 00000100:00100000:1.0:1783135459.962129:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813284096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135459.962225:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135459.962381:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813284096 00000100:00100000:3.0:1783135459.962393:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813284096 00000100:00100000:3.0:1783135459.962453:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783135459.962463:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813284096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135459.962509:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135459.962566:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813284096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135459.962573:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1783135459.962991:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f37b82a00 x1869752813284096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135459.963020:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813284096:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783135460.282716:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135461.306628:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135461.366795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135461.366895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135461.366946:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135461.366991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135461.367029:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792276224 00000100:00100000:3.0:1783135461.367042:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792276224 00000100:00100000:3.0:1783135461.367208:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792276480 00000100:00100000:3.0:1783135461.367212:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792276480 00000100:00100000:3.0:1783135461.367249:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 114 00000100:00100000:0.0:1783135461.367257:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792276352 00000100:00100000:3.0:1783135461.367264:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792276224:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135461.367265:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792276352 00000100:00100000:0.0:1783135461.367313:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00100000:0.0:1783135461.367323:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792276352:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135461.367372:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792276224:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 112us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135461.367381:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 114 00000100:00100000:3.0:1783135461.367419:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 115 00000100:00100000:3.0:1783135461.367432:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792276480:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135461.367453:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792276096 00000100:00100000:2.0:1783135461.367471:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792276096 00000100:00100000:2.0:1783135461.367553:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 277 00000100:00100000:2.0:1783135461.367565:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792276096:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135461.370079:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792276352:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 2739us (3165us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135461.370097:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00080000:0.0:1783135461.370220:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135461.370229:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135461.374571:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792276096:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 6992us (7775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135461.374585:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792276480:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 7145us (7580us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135461.374606:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 115 00000100:00100000:2.0:1783135461.374658:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 277 00000100:00100000:3.0:1783135462.010919:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813284224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135462.011042:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135462.012226:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813284224 00000100:00100000:0.0:1783135462.012243:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813284224 00000100:00100000:0.0:1783135462.012340:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135462.012352:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813284224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135462.012404:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135462.012515:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813284224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135462.012524:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783135462.012658:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813284224:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783135462.014163:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783135462.331155:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135463.354907:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135464.379511:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135464.570253:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813284352:0@lo:400:kworker.0 00000100:00100000:0.0:1783135464.570367:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135464.570513:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813284352 00000100:00100000:2.0:1783135464.570523:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813284352 00000100:00100000:2.0:1783135464.570603:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1783135464.570615:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813284352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135464.572992:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813284480:0@lo:400:kworker.0 00000100:00100000:3.0:1783135464.573090:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135464.573197:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813284480 00000100:00100000:3.0:1783135464.573207:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813284480 00000100:00100000:3.0:1783135464.573268:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783135464.573278:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813284480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135464.573341:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813284480:12345-0@lo:400:kworker.0 Request processed in 63us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135464.573349:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1783135464.573408:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813284480:0@lo:400:kworker.0 00000100:00100000:2.0:1783135464.582405:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813284352:12345-0@lo:400:kworker.0 Request processed in 11775us (12020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135464.582425:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1783135464.582632:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813284352:0@lo:400:kworker.0 00000100:00100000:3.0:1783135464.584206:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135464.584498:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135464.584524:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813284736:0@lo:400:kworker.0 00000100:00100000:2.0:1783135464.584621:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135464.584841:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813284608:0@lo:400:kworker.0 00000100:00100000:3.0:1783135464.584883:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135464.584975:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813284608 00000100:00100000:2.0:1783135464.584984:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813284608 00000100:00100000:2.0:1783135464.585063:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1783135464.585076:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813284608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135464.585141:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813284608:12345-0@lo:400:kworker.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135464.585149:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1783135464.585275:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135464.585316:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813284608:0@lo:400:kworker.0 00000100:00100000:0.0:1783135464.585395:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813284736 00000100:00100000:0.0:1783135464.585401:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813284736 00000100:00100000:0.0:1783135464.585457:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783135464.585466:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813284736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135464.585526:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813284736:12345-0@lo:400:kworker.0 Request processed in 62us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135464.585532:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1783135464.585580:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135464.585636:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813284736:0@lo:400:kworker.0 00000100:00100000:0.0:1783135464.586262:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813284864:0@lo:400:kworker.0 00000100:00100000:0.0:1783135464.586312:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135464.586449:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813284992:0@lo:400:kworker.0 00000100:00100000:2.0:1783135464.586482:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135464.586522:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813284992 00000100:00100000:2.0:1783135464.586528:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813284992 00000100:00100000:2.0:1783135464.586574:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783135464.586582:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813284992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135464.586626:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813284992:12345-0@lo:400:kworker.0 Request processed in 45us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135464.586632:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1783135464.586661:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3b9dd880 x1869752813284992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135464.586673:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813284992:0@lo:400:kworker.0 00000100:00100000:3.0:1783135464.593252:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813284864 00000100:00100000:3.0:1783135464.593278:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813284864 00000100:00100000:3.0:1783135464.593380:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1783135464.593393:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813284864:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783135464.593889:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135464.593897:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135464.594175:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813284864:12345-0@lo:400:kworker.0 Request processed in 782us (7859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135464.594186:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1783135464.595032:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813284864:0@lo:400:kworker.0 00000100:00100000:2.0:1783135465.082053:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813285120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135465.082204:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135465.082307:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813285120 00000100:00100000:1.0:1783135465.082326:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813285120 00000100:00100000:1.0:1783135465.082409:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783135465.082422:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813285120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135465.082473:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135465.082569:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813285120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135465.082579:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1783135465.083050:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3d854e00 x1869752813285120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135481 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135465.083083:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813285120:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783135465.402599:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135466.427927:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135466.488606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135466.488653:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135466.489296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135466.489346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135466.489375:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792276736 00000100:00100000:3.0:1783135466.489383:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792276736 00000100:00100000:3.0:1783135466.489430:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792276992 00000100:00100000:3.0:1783135466.489433:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792276992 00000100:00100000:3.0:1783135466.489461:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 119 00000100:00100000:3.0:1783135466.489981:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+5:2360:x1869752792276736:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135466.490072:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+5:2360:x1869752792276736:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 101us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135466.490091:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 119 00000100:00100000:3.0:1783135466.490122:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 120 00000100:00100000:3.0:1783135466.490141:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2360:x1869752792276992:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135466.490170:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2360:x1869752792276992:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 30us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135466.490176:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 120 00000100:00100000:1.0:1783135466.490318:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792276864 00000100:00100000:1.0:1783135466.490325:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792276864 00000100:00100000:1.0:1783135466.490373:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 67 00000100:00100000:1.0:1783135466.490380:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792276864:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135466.490417:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792276864:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 37us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135466.490424:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 67 00000100:00100000:2.0:1783135466.490685:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792276608 00000100:00100000:2.0:1783135466.490691:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792276608 00000100:00100000:2.0:1783135466.490747:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 279 00000100:00100000:2.0:1783135466.490756:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792276608:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135466.490834:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792276608:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 59us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135466.490843:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 279 00000100:00080000:2.0:1783135466.490874:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135466.490878:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135467.130796:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135467.130848:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813285248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135467.130949:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135467.131123:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813285248 00000100:00100000:0.0:1783135467.131134:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813285248 00000100:00100000:0.0:1783135467.131216:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783135467.131228:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813285248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135467.131274:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135467.131350:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813285248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135467.131359:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783135467.131400:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813285248:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783135467.131637:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1783135467.388912:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783135467.450580:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135467.643582:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813285504:0@lo:400:kworker.0 00000100:00100000:0.0:1783135467.643606:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813285760:0@lo:400:kworker.0 00000100:00100000:2.0:1783135467.643611:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813285376:0@lo:400:kworker.0 00000100:00100000:1.0:1783135467.643718:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813285632:0@lo:400:kworker.0 00000100:00100000:0.0:1783135467.643913:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135467.644010:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813285760 00000100:00100000:0.0:1783135467.644018:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813285760 00000100:00100000:0.0:1783135467.645332:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783135467.645352:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813285760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135467.646350:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813285760:12345-0@lo:400:kworker.0 Request processed in 1002us (2433us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135467.647381:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135467.647440:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813285888:0@lo:400:kworker.0 00000100:00100000:2.0:1783135467.647476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135467.647888:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813285376 00000100:00100000:2.0:1783135467.647896:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813285376 00000100:00100000:2.0:1783135467.647943:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783135467.647967:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813285376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135467.648017:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813285376:12345-0@lo:400:kworker.0 Request processed in 52us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135467.648024:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783135467.648312:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813285376:0@lo:400:kworker.0 00000100:00100000:2.0:1783135467.648357:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813285888 00000100:00100000:2.0:1783135467.648361:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813285888 00000100:00100000:2.0:1783135467.648399:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783135467.648406:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813285888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135467.648426:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783135467.648471:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813285760:0@lo:400:kworker.0 00000100:00080000:0.0:1783135467.648509:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135467.648916:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d857480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813285888:12345-0@lo:400:kworker.0 Request processed in 508us (1436us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135467.648924:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1783135467.649012:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813285888:0@lo:400:kworker.0 00000100:00100000:3.0:1783135467.650741:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135467.650851:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813286016:0@lo:400:kworker.0 00000100:00100000:0.0:1783135467.650866:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813285504 00000100:00100000:0.0:1783135467.650881:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813285504 00000100:00100000:3.0:1783135467.650920:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135467.650961:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783135467.650974:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813285504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135467.651034:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813286016 00000100:00100000:3.0:1783135467.651044:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813286016 00000100:00100000:3.0:1783135467.651107:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135467.651116:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813286016:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783135467.651243:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135467.651463:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813286016:12345-0@lo:400:kworker.0 Request processed in 346us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135467.651473:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1783135467.651724:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135467.651875:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813285504:0@lo:400:kworker.0 00010000:00080000:2.0:1783135467.651898:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3db58e00 x1869752813286016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135483 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135467.651909:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db58e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813286016:0@lo:400:kworker.0 00000100:00100000:3.0:1783135467.653745:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813285632 00000100:00100000:3.0:1783135467.653770:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813285632 00000100:00100000:3.0:1783135467.653911:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783135467.653923:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813285632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135467.654029:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813285632:12345-0@lo:400:kworker.0 Request processed in 108us (2304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135467.654037:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1783135467.654133:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135467.654230:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813285632:0@lo:400:kworker.0 00000100:00100000:0.0:1783135467.656203:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813285504:12345-0@lo:400:kworker.0 Request processed in 5220us (5460us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135467.656220:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00010000:00010000:0.0:1783135468.475019:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135469.499322:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135470.202109:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135470.202136:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813286144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135470.202212:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135470.202569:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813286144 00000100:00100000:2.0:1783135470.202580:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813286144 00000100:00100000:2.0:1783135470.202651:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135470.202662:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813286144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135470.202704:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135470.202770:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813286144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135470.202798:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1783135470.202871:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3d855f80 x1869752813286144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135470.202893:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813286144:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783135470.202969:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783135470.523677:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135471.546256:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135471.622847:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135471.622895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135471.622995:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792277120 00000100:00100000:0.0:1783135471.623007:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792277120 00000100:00100000:0.0:1783135471.623073:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 281 00000100:00100000:0.0:1783135471.623084:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792277120:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135471.623176:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792277120:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 93us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135471.623185:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 281 00000100:00100000:1.0:1783135471.624362:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135471.635561:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135471.635688:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792277376 00000100:00100000:0.0:1783135471.635803:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792277376 00000100:00100000:0.0:1783135471.635911:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:0.0:1783135471.635922:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2359:x1869752792277376:12345-192.168.201.60@tcp:9:kworker.0 00000020:00000080:0.0:1783135471.635956:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875ca85 00000100:00080000:0.0:1783135471.635965:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8f04f3f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783135471.636006:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1783135471.636301:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+2:2359:x1869752792277376:12345-192.168.201.60@tcp:9:kworker.0 Request processed in 380us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135471.636309:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 19 00010000:00010000:0.0:1783135471.636352:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135471.640211:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135471.643489:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792277248 00000100:00100000:2.0:1783135471.643505:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792277248 00000100:00100000:2.0:1783135471.643600:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792277504 00000100:00100000:2.0:1783135471.643604:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792277504 00000100:00100000:2.0:1783135471.643632:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 124 00000100:00100000:2.0:1783135471.643642:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792277248:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135471.643737:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792277248:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 96us (20841us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135471.643745:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 124 00000100:00100000:2.0:1783135471.643763:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 125 00000100:00100000:2.0:1783135471.643770:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792277504:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135471.643797:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792277504:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 28us (19441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135471.643803:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 125 00000100:00080000:1.0:1783135471.646223:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135472.250261:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135472.250297:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813286272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135472.250397:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135472.250525:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813286272 00000100:00100000:3.0:1783135472.250541:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813286272 00000100:00100000:3.0:1783135472.250642:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783135472.250656:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813286272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135472.250743:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135472.250901:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813286272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 247us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135472.250915:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1783135472.251022:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135472.253476:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813286272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783135472.571183:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135472.762203:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813286656:0@lo:400:kworker.0 00000100:00100000:0.0:1783135472.762309:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135472.762385:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135472.762390:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813286656 00000100:00100000:0.0:1783135472.762395:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813286784:0@lo:400:kworker.0 00000100:00100000:3.0:1783135472.762406:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813286656 00000100:00100000:0.0:1783135472.762429:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135472.762472:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813286528:0@lo:400:kworker.0 00000100:00100000:3.0:1783135472.762514:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1783135472.762544:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813286656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135472.762644:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813286656:12345-0@lo:400:kworker.0 Request processed in 106us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135472.762858:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db5ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813286656:0@lo:400:kworker.0 00000100:00100000:0.0:1783135472.762908:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135472.762933:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813286528 00000100:00100000:0.0:1783135472.762939:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813286528 00000100:00100000:0.0:1783135472.762987:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783135472.763003:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813286528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135472.763033:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813286784 00000100:00100000:2.0:1783135472.763046:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813286784 00000100:00100000:0.0:1783135472.763059:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813286528:12345-0@lo:400:kworker.0 Request processed in 60us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135472.763073:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1783135472.763119:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813286528:0@lo:400:kworker.0 00000100:00100000:0.0:1783135472.763142:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813287040:0@lo:400:kworker.0 00000100:00100000:0.0:1783135472.763168:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135472.763192:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813287040 00000100:00100000:0.0:1783135472.763197:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813287040 00000100:00100000:1.0:1783135472.763324:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813286400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135472.763368:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135472.763389:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1783135472.763410:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813286912:0@lo:400:kworker.0 00000100:00100000:1.0:1783135472.763436:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135472.763479:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1783135472.763485:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135472.763494:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813286784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135472.763501:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813286912 00000100:00100000:1.0:1783135472.763508:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813286912 00000100:00100000:3.0:1783135472.763568:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813286784:12345-0@lo:400:kworker.0 Request processed in 77us (1138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135472.763569:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783135472.763587:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783135472.763589:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813286912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135472.763642:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813286400 00000100:00100000:3.0:1783135472.763649:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813286400 00000100:00100000:1.0:1783135472.763650:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813286912:12345-0@lo:400:kworker.0 Request processed in 67us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135472.763662:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783135472.763701:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00080000:1.0:1783135472.763704:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135472.763714:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813286400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135472.763748:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db5a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813286912:0@lo:400:kworker.0 00000100:00100000:3.0:1783135472.763769:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813286400:12345-0@lo:400:kworker.0 Request processed in 57us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135472.763783:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813286400:0@lo:400:kworker.0 00000100:00100000:3.0:1783135472.763784:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1783135472.763889:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813286784:0@lo:400:kworker.0 00000100:00100000:0.0:1783135472.764444:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783135472.764453:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813287040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135472.764512:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813287040:12345-0@lo:400:kworker.0 Request processed in 60us (1343us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135472.764521:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1783135472.765345:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783135472.765406:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3db5b100 x1869752813287040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135488 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135472.765422:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813287040:0@lo:400:kworker.0 00010000:00010000:2.0:1783135473.594936:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783135473.849043:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:2.0:1783135473.849057:0:6616:0:(genops.c:906:class_export_put()) final put ffff8e8f3bf68000/0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:0.0:1783135473.849216:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3bf68000/0c7819a6-778a-4617-af33-00460db74182 for lustre-OST0000 00000020:00000080:0.0:1783135473.849786:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f04f3f800 for lustre-OST0000 00010000:00010000:0.0:1783135474.619990:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135475.323652:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783135475.325188:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813287168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135475.325298:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135475.328384:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813287168 00000100:00100000:2.0:1783135475.328406:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813287168 00000100:00100000:2.0:1783135475.328510:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135475.328522:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813287168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135475.328587:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135475.328700:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813287168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 179us (3401us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135475.328708:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1783135475.328796:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783135475.332996:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3db58000 x1869752813287168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135475.333038:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813287168:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783135475.643259:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135476.669424:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135476.725877:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135476.725932:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135476.725957:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135476.725998:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792277760 00000100:00100000:3.0:1783135476.726008:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792277760 00000100:00100000:3.0:1783135476.726061:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792277888 00000100:00100000:3.0:1783135476.726064:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792277888 00000100:00100000:3.0:1783135476.726089:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 129 00000100:00100000:3.0:1783135476.726100:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792277760:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135476.726174:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792277760:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135476.726181:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 129 00000100:00100000:3.0:1783135476.726198:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 130 00000100:00100000:3.0:1783135476.726205:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792277888:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135476.726228:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792277888:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 25us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135476.726234:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 130 00000100:00100000:3.0:1783135476.726254:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792277632 00000100:00100000:3.0:1783135476.726257:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792277632 00000100:00100000:3.0:1783135476.726279:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 283 00000100:00100000:3.0:1783135476.726286:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792277632:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135476.726309:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792277632:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 24us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135476.726315:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 283 00000100:00080000:3.0:1783135476.726361:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135477.378214:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813287296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135477.378295:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135477.378629:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813287296 00000100:00100000:0.0:1783135477.378638:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813287296 00000100:00100000:0.0:1783135477.378714:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783135477.378725:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813287296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135477.378764:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1783135477.378843:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135477.382319:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813287296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3586us (4013us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135477.382336:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135477.386534:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813287296:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1783135477.627351:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135477.691574:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135477.883432:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813287680:0@lo:400:kworker.0 00000100:00100000:0.0:1783135477.883506:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135477.883599:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135477.883607:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813287808:0@lo:400:kworker.0 00000100:00100000:0.0:1783135477.883634:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135477.883776:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813287680 00000100:00100000:2.0:1783135477.883784:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813287680 00000100:00100000:2.0:1783135477.883872:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1783135477.883883:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813287680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135477.883938:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813287680:12345-0@lo:400:kworker.0 Request processed in 58us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135477.883945:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1783135477.884109:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813287680:0@lo:400:kworker.0 00000100:00100000:1.0:1783135477.884202:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813287424:0@lo:400:kworker.0 00000100:00100000:1.0:1783135477.884237:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135477.884273:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813287936:0@lo:400:kworker.0 00000100:00100000:1.0:1783135477.884295:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135477.884320:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135477.884327:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813287552:0@lo:400:kworker.0 00000100:00100000:1.0:1783135477.884349:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135477.884362:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813288064:0@lo:400:kworker.0 00000100:00100000:1.0:1783135477.884380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135477.884516:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813287936 00000100:00100000:2.0:1783135477.884520:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813287936 00000100:00100000:2.0:1783135477.884557:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813287552 00000100:00100000:2.0:1783135477.884560:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813287552 00000100:00100000:2.0:1783135477.884575:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783135477.884591:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813287936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135477.884630:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813287936:12345-0@lo:400:kworker.0 Request processed in 48us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135477.884636:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1783135477.884649:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783135477.884667:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813287552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135477.884708:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813287552:12345-0@lo:400:kworker.0 Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135477.884714:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1783135477.884732:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813287808 00000100:00100000:2.0:1783135477.884735:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813287808 00000100:00100000:2.0:1783135477.884756:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813288064 00000100:00100000:2.0:1783135477.884758:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813288064 00000100:00100000:2.0:1783135477.884777:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135477.884783:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813287808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135477.884839:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813287808:12345-0@lo:400:kworker.0 Request processed in 32us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135477.884856:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135477.884866:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783135477.884871:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813288064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135477.884894:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813288064:12345-0@lo:400:kworker.0 Request processed in 24us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135477.884899:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783135477.885102:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813287424 00000100:00100000:0.0:1783135477.885107:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813287424 00000100:00100000:0.0:1783135477.885139:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783135477.885153:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813287424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135477.885183:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813287424:12345-0@lo:400:kworker.0 Request processed in 31us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135477.885188:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783135477.885231:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813287808:0@lo:400:kworker.0 00000100:00080000:3.0:1783135477.885463:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135477.885468:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135477.885544:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d856d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813287552:0@lo:400:kworker.0 00010000:00080000:1.0:1783135477.885559:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3d854380 x1869752813288064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135493 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135477.885570:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d854380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813288064:0@lo:400:kworker.0 00000100:00100000:1.0:1783135477.885580:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813287424:0@lo:400:kworker.0 00000100:00100000:1.0:1783135477.885600:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d856a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813287936:0@lo:400:kworker.0 00010000:00010000:0.0:1783135478.720426:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783135479.020722:0:11704:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:24:37 (1783135477) 00010000:00010000:2.0:1783135479.738166:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135480.442229:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813288192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135480.442311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135480.442567:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813288192 00000100:00100000:3.0:1783135480.442576:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813288192 00000100:00100000:3.0:1783135480.442670:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783135480.442680:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813288192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135480.442714:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135480.442778:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d855c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813288192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.442785:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1783135480.442978:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1783135480.443007:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3db58700 x1869752813288192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135480.443026:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813288192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135480.593751:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135480.594049:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792278016 00000100:00100000:3.0:1783135480.594060:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792278016 00000100:00100000:3.0:1783135480.594146:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 32 00000100:00100000:3.0:1783135480.594159:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+5:10215:x1869752792278016:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135480.594181:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135480.594221:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cb50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11dfa expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135480.594525:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cb57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135480.594553:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cb57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135480.594567:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cb57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135480.594785:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783135480.594790:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135480.594936:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cb57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135480.594970:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cb50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dfa expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135480.595004:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cb57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dfa expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135480.595015:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135480.595018:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135480.595022:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486200, rc 0) 00000100:00100000:3.0:1783135480.595187:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+6:10215:x1869752792278016:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 1030us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135480.595268:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 32 00000100:00080000:2.0:1783135480.596111:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135480.606802:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135480.606951:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792278144 00000100:00100000:0.0:1783135480.606962:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792278144 00000100:00100000:0.0:1783135480.607012:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:0.0:1783135480.607020:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+6:10216:x1869752792278144:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135480.607039:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135480.607059:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221400/0xf646e0cda875cb5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e01 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607124:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607139:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607150:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607180:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607187:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607207:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607671:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cb73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607683:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cb73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607691:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cb73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135480.607782:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783135480.607787:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135480.607899:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cb73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607911:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607917:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607924:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607941:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135480.607946:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607953:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607967:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:0.0:1783135480.607971:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135480.607976:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607982:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.607995:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608001:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608007:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608012:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135480.608015:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608021:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608040:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e8f032fc800) 00010000:00010000:0.0:1783135480.608043:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135480.608046:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608052:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608086:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221400/0xf646e0cda875cb5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e01 expref: 8 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608101:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cb73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e01 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.608108:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8f032fc400) 00010000:00010000:0.0:1783135480.608111:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135480.608113:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05221c00, rc 0) 00000100:00100000:0.0:1783135480.608193:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+7:10216:x1869752792278144:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 1173us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.608202:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:1.0:1783135480.620608:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135480.620764:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792278400 00000100:00100000:0.0:1783135480.620774:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792278400 00000100:00100000:0.0:1783135480.620883:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 34 00000100:00100000:0.0:1783135480.620894:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+7:10216:x1869752792278400:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135480.620917:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135480.620937:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221400/0xf646e0cda875cb7a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e08 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.621033:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.621047:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.621058:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.621115:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.621123:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.621130:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.623054:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cb8f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.623074:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cb8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.623082:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cb8f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135480.623094:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783135480.624600:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.624616:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.625755:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.625762:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135480.625767:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.625776:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.625795:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8f032fc400) 00010000:00010000:0.0:1783135480.625798:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135480.625802:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.625809:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cb81 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.626375:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.626386:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.626392:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.626399:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135480.626402:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.626429:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.626439:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8f032fc800) 00010000:00010000:0.0:1783135480.626442:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135480.626445:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.626450:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cb88 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.627645:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221400/0xf646e0cda875cb7a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e08 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.627665:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cb8f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e08 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135480.627673:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:0.0:1783135480.627676:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135480.627679:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05221200, rc 0) 00000100:00100000:0.0:1783135480.627752:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+9:10216:x1869752792278400:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 6860us (7152us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783135480.627761:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 34 00000100:00100000:2.0:1783135480.668717:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135480.668887:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792278528 00000100:00100000:0.0:1783135480.668897:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792278528 00000100:00100000:0.0:1783135480.668961:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 35 00000100:00100000:0.0:1783135480.668972:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+9:10216:x1869752792278528:12345-192.168.201.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783135480.669111:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d856a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+9:10216:x1869752792278528:12345-192.168.201.60@tcp:59:lhsmtool_posix.0 Request processed in 140us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135480.669119:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 35 00000040:00080000:1.0:1783135480.698523:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1783135480.764369:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135481.786249:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135481.846670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135481.846717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135481.846753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135481.846780:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792278656 00000100:00100000:3.0:1783135481.846789:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792278656 00000100:00100000:0.0:1783135481.846853:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792278784 00000100:00100000:3.0:1783135481.846855:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 285 00000100:00100000:0.0:1783135481.846857:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792278784 00000100:00100000:3.0:1783135481.846865:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2360:x1869752792278656:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135481.846883:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792278912 00000100:00100000:0.0:1783135481.846885:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792278912 00000100:00100000:0.0:1783135481.846919:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 134 00000100:00100000:0.0:1783135481.846925:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792278784:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135481.846939:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2360:x1869752792278656:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 76us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135481.846947:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 285 00000100:00100000:0.0:1783135481.846955:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792278784:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 31us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135481.846960:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 134 00000100:00100000:0.0:1783135481.846971:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 135 00000100:00100000:0.0:1783135481.846976:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2360:x1869752792278912:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135481.846998:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2360:x1869752792278912:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 22us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135481.847004:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 135 00000100:00080000:0.0:1783135481.847028:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135482.490085:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135482.490118:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813288320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135482.490219:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135482.490980:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813288320 00000100:00100000:3.0:1783135482.490998:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813288320 00000100:00100000:3.0:1783135482.491086:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783135482.491098:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813288320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135482.491151:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783135482.491220:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135482.491263:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813288320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135482.491272:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783135482.491307:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813288320:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783135482.812711:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135482.824974:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135482.825049:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792279040 00000100:00100000:3.0:1783135482.825059:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792279040 00000100:00100000:3.0:1783135482.825135:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 36 00000100:00100000:3.0:1783135482.825145:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+9:10258:x1869752792279040:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135482.825164:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135482.825183:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cb9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e0f expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825246:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825261:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825272:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825286:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825293:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825300:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825570:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825587:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825594:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825600:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135482.825605:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825612:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825624:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135482.825627:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135482.825631:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825637:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875cba4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825650:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825656:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825662:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825667:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135482.825676:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825682:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825690:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8f08840a00) 00010000:00010000:3.0:1783135482.825693:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135482.825696:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825702:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cbab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825735:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cb9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e0f expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825746:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135482.825748:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135482.825752:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cb9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e0f expref: 10 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.825761:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487200, rc 0) 00000100:00100000:3.0:1783135482.826002:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+9:10258:x1869752792279040:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 857us (1038us total) trans 0 rc 301/301 00000100:00100000:3.0:1783135482.826010:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 36 00000100:00080000:2.0:1783135482.826177:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135482.830466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135482.830932:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792279296 00000100:00100000:3.0:1783135482.830944:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792279296 00000100:00100000:3.0:1783135482.830994:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00100000:3.0:1783135482.831003:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+9:10258:x1869752792279296:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:3.0:1783135482.831080:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135482.831108:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cb57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dfa expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.831129:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135482.831141:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135482.831410:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.831423:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.831433:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.831445:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.831451:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.831457:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135482.834548:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1783135482.834565:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.834575:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.834582:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.834595:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135482.834600:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.834607:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.834623:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:3.0:1783135482.834626:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135482.834630:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135482.834635:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cbb2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135482.834655:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004890d3db reply state 00000000da61cd40 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135482.834664:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135482.834772:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d855180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+10:10258:x1869752792279296:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 3765us (4310us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1783135482.834781:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 37 00010000:00010000:2.0:1783135482.840739:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135482.840757:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135482.840766:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135482.840773:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135482.840778:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135482.840786:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135482.840803:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8f08840d00) 00010000:00010000:2.0:1783135482.840806:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135482.840810:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135482.840867:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875cbb9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135482.988561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135482.990530:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792279424 00000100:00100000:1.0:1783135482.990546:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792279424 00000100:00100000:1.0:1783135482.990625:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:1.0:1783135482.990636:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+9:10266:x1869752792279424:12345-192.168.201.60@tcp:101:lctl.0 00010000:00010000:1.0:1783135482.990662:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135482.990685:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cbc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e16 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135482.990760:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cbc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135482.990776:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135482.990789:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135482.990891:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783135482.990895:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135482.990944:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cbc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135482.990973:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cbc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e16 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135482.990993:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cbc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e16 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135482.991002:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:1.0:1783135482.991021:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135482.991025:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121ca00, rc 0) 00000100:00100000:1.0:1783135482.991113:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d856d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+10:10266:x1869752792279424:12345-192.168.201.60@tcp:101:lctl.0 Request processed in 479us (2561us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135482.991121:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:0.0:1783135483.002752:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813288832:0@lo:400:kworker.0 00000100:00100000:2.0:1783135483.002770:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813288704:0@lo:400:kworker.0 00000100:00100000:2.0:1783135483.002854:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135483.002855:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135483.002931:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813288576:0@lo:400:kworker.0 00000100:00100000:1.0:1783135483.002951:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813288448:0@lo:400:kworker.0 00000100:00100000:0.0:1783135483.003717:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813288832 00000100:00100000:0.0:1783135483.003728:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813288832 00000100:00100000:0.0:1783135483.003789:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135483.003799:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813288832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135483.003930:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813288832:12345-0@lo:400:kworker.0 Request processed in 132us (1083us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135483.003938:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135483.003987:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813288832:0@lo:400:kworker.0 00000100:00100000:0.0:1783135483.004188:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813288704 00000100:00100000:0.0:1783135483.004193:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813288704 00000100:00100000:0.0:1783135483.004233:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1783135483.004240:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813288704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135483.004375:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d855f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813288704:12345-0@lo:400:kworker.0 Request processed in 135us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135483.004382:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1783135483.004400:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135483.004425:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db5b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813288704:0@lo:400:kworker.0 00000100:00100000:2.0:1783135483.009160:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135483.009160:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135483.009213:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813288448 00000100:00100000:3.0:1783135483.009222:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813288448 00000100:00100000:0.0:1783135483.009225:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813288960:0@lo:400:kworker.0 00000100:00100000:3.0:1783135483.009279:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1783135483.009288:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813288448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135483.009345:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813288448:12345-0@lo:400:kworker.0 Request processed in 57us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135483.009367:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1783135483.009484:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813289088:0@lo:400:kworker.0 00000100:00100000:0.0:1783135483.009512:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135483.009555:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135483.010273:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813289088 00000100:00100000:1.0:1783135483.010280:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813289088 00000100:00100000:1.0:1783135483.010331:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783135483.010340:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813289088:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783135483.010370:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135483.010409:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db58700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813288448:0@lo:400:kworker.0 00000100:00100000:1.0:1783135483.010420:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813289088:12345-0@lo:400:kworker.0 Request processed in 79us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.010428:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783135483.010560:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813288576 00000100:00100000:3.0:1783135483.010564:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813288576 00000100:00100000:3.0:1783135483.011032:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813288960 00000100:00100000:3.0:1783135483.011037:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813288960 00000100:00100000:3.0:1783135483.011069:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783135483.011076:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813288576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135483.011119:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d855500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813288576:12345-0@lo:400:kworker.0 Request processed in 44us (1968us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135483.011125:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783135483.011136:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783135483.011141:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813288960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135483.011164:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813288960:12345-0@lo:400:kworker.0 Request processed in 23us (1653us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135483.011170:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1783135483.011234:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135483.011305:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813288960:0@lo:400:kworker.0 00000100:00100000:2.0:1783135483.011383:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813288576:0@lo:400:kworker.0 00010000:00080000:2.0:1783135483.011398:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3db59f80 x1869752813289088/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783135499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135483.011409:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813289088:0@lo:400:kworker.0 00000100:00100000:3.0:1783135483.068908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.069134:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792279552 00000100:00100000:0.0:1783135483.069144:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792279552 00000100:00100000:0.0:1783135483.069226:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:0.0:1783135483.069236:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+10:10272:x1869752792279552:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135483.069265:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135483.069297:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221400/0xf646e0cda875cbce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e1d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069372:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069390:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069402:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069417:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069424:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069430:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069561:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05220200/0xf646e0cda875cbe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069569:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05220200/0xf646e0cda875cbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069576:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05220200/0xf646e0cda875cbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135483.069629:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1783135483.069632:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135483.069675:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05220200/0xf646e0cda875cbe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069697:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069705:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069712:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069718:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135483.069723:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069732:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069744:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:0.0:1783135483.069747:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135483.069752:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069758:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221e00/0xf646e0cda875cbd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069772:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069778:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069784:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069968:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135483.069972:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069978:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069987:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8e8f032fc800) 00010000:00010000:0.0:1783135483.069989:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135483.069992:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.069996:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221600/0xf646e0cda875cbdc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.070027:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221400/0xf646e0cda875cbce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e1d expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.070040:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05220200/0xf646e0cda875cbe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e1d expref: 11 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.070047:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:0.0:1783135483.070049:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783135483.070052:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f05220200, rc 0) 00000100:00100000:0.0:1783135483.070112:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+11:10272:x1869752792279552:12345-192.168.201.60@tcp:101:bash.0 Request processed in 878us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135483.070121:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:2.0:1783135483.076183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.076273:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792279808 00000100:00100000:0.0:1783135483.076296:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792279808 00000100:00100000:0.0:1783135483.076351:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 40 00000100:00100000:0.0:1783135483.076362:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+11:10272:x1869752792279808:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135483.076385:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135483.076407:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875cbea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e24 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.076561:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.076576:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.076588:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.076778:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.076788:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.076804:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135483.077423:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1783135483.078184:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078198:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078218:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078257:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078264:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078271:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078278:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135483.078283:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078290:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078303:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:0.0:1783135483.078306:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135483.078310:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078316:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cbf1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135483.078328:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000981d782f reply state 00000000192022e1 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135483.078336:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135483.078379:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875cbea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 14 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078395:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 13 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.078402:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f180c6800) 00010000:00010000:0.0:1783135483.078405:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135483.078407:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043800, rc 0) 00000100:00100000:0.0:1783135483.078484:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+14:10272:x1869752792279808:12345-192.168.201.60@tcp:101:bash.0 Request processed in 2123us (2310us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1783135483.078502:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 40 00010000:00010000:1.0:1783135483.080945:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.080964:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.080972:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.080978:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135483.080983:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.080990:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.081031:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f180c6e00) 00010000:00010000:1.0:1783135483.081033:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135483.081037:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.081043:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875cbf8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135483.085022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.086247:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792279936 00000100:00100000:0.0:1783135483.086260:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792279936 00000100:00100000:0.0:1783135483.086359:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:0.0:1783135483.086367:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1869752792279936:12345-192.168.201.60@tcp:8:bash.0 00010000:00080000:0.0:1783135483.086399:0:8303:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:0.0:1783135483.086429:0:8303:0:(genops.c:1406:class_connect()) connect: client 0c7819a6-778a-4617-af33-00460db74182, cookie 0xf646e0cda875cc0d 00002000:00100000:0.0:1783135483.086442:0:8303:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0c7819a6-778a-4617-af33-00460db74182/ffff8e8f3d61e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135483.086466:0:8303:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135483.086709:0:8303:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1783135483.086740:0:8303:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d619800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135483.087093:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+6:2359:x1869752792279936:12345-192.168.201.60@tcp:8:bash.0 Request processed in 723us (2578us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135483.087102:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:1.0:1783135483.089421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135483.089799:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792280064 00000100:00100000:2.0:1783135483.089809:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792280064 00000100:00100000:2.0:1783135483.089893:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:2.0:1783135483.089904:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+6:0:x1869752792280064:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135483.089923:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135483.089949:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e2b expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135483.089976:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135483.089996:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=382s v=(0 0) 00010000:00010000:2.0:1783135483.090015:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135483.090025:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.090045:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.090059:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2200, rc 0) 00000100:00100000:2.0:1783135483.090110:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:0:x1869752792280064:12345-192.168.201.60@tcp:101:bash.0 Request processed in 208us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135483.090116:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00080000:1.0:1783135483.090299:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135483.095204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135483.095287:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792280192 00000100:00100000:2.0:1783135483.095296:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792280192 00000100:00100000:2.0:1783135483.095376:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:2.0:1783135483.095385:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:10272:x1869752792280192:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135483.095402:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135483.095420:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e32 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.095450:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.095459:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135483.095463:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135483.095468:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.095708:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 8 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.095723:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 8 pid: 6587 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135483.095737:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6587:1869752813289216:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135483.095910:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135483.099911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.100105:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792280320 00000100:00100000:1.0:1783135483.100115:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792280320 00010000:00010000:1.0:1783135483.100151:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 9 pid: 6587 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135483.100194:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 35 00000100:00100000:1.0:1783135483.100203:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+9:2361:x1869752792280320:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135483.100218:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135483.100239:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 9 pid: 6587 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.100253:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 9 pid: 6587 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.100282:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135483.100287:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135483.100296:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.100322:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.100360:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135483.100375:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c39f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1869752813289344:192.168.201.60@tcp:105: 00000100:00100000:1.0:1783135483.100453:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205d80 going to sleep for 11 seconds 00010000:00010000:0.0:1783135483.101477:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e6249da/0xf646e0cda875cc14 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e2b expref: 9 pid: 6587 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135483.101521:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6587:1869752813289216:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135483.101552:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.101565:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2400, rc 0) 00000100:00100000:0.0:1783135483.101716:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+8:10272:x1869752792280192:12345-192.168.201.60@tcp:101:bash.0 Request processed in 6330us (6521us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135483.101726:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:1.0:1783135483.108180:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c39f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1869752813289344:192.168.201.60@tcp:105: 00010000:00010000:1.0:1783135483.108206:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135483.108268:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792280320:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 8065us (8364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.108280:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 35 00000100:00100000:2.0:1783135483.112195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.112268:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792280576 00000100:00100000:0.0:1783135483.112277:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792280576 00000100:00100000:0.0:1783135483.112332:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:0.0:1783135483.112341:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+13:10272:x1869752792280576:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1783135483.112731:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+14:10272:x1869752792280576:12345-192.168.201.60@tcp:35:bash.0 Request processed in 389us (543us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783135483.112739:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:3.0:1783135483.197852:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.197897:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792280832 00000100:00100000:0.0:1783135483.197909:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792280832 00000100:00100000:0.0:1783135483.198021:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:0.0:1783135483.198033:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+14:10282:x1869752792280832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135483.198056:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135483.198076:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875cc22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e39 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135483.198191:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1783135483.198313:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875cc22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e39 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.198328:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:0.0:1783135483.198331:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135483.198336:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875cc22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e39 expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.198351:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042e00, rc 0) 00000100:00100000:0.0:1783135483.198462:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+15:10282:x1869752792280832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 431us (618us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1783135483.198469:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:3.0:1783135483.201759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.201858:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792281088 00000100:00100000:0.0:1783135483.201866:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792281088 00000100:00100000:0.0:1783135483.201916:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:0.0:1783135483.201924:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+15:10282:x1869752792281088:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135483.202171:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+16:10282:x1869752792281088:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 246us (418us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783135483.202179:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:2.0:1783135483.291201:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.291703:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792281216 00000100:00100000:1.0:1783135483.291713:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792281216 00000100:00100000:1.0:1783135483.291778:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:1.0:1783135483.291789:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+16:10288:x1869752792281216:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135483.291810:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135483.291854:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cc30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e40 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.292255:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875cc37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.292270:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875cc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.292294:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875cc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135483.292353:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1783135483.292357:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135483.292378:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875cc37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.292402:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cc30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e40 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.292421:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875cc37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e40 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.292429:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135483.292432:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135483.292436:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c000, rc 0) 00000100:00100000:1.0:1783135483.292503:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+17:10288:x1869752792281216:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 715us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.292510:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:3.0:1783135483.297986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.298301:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792281472 00000100:00100000:1.0:1783135483.298314:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792281472 00000100:00100000:1.0:1783135483.298371:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:1.0:1783135483.298381:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+17:10288:x1869752792281472:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135483.298402:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135483.298424:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cc3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e47 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.298579:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cc45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.298595:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cc45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.298606:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cc45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135483.298617:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783135483.300442:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cc3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e47 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.300473:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cc45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e47 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.300484:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f180c6800) 00010000:00010000:1.0:1783135483.300498:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135483.300503:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121da00, rc 0) 00000100:00100000:1.0:1783135483.300585:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+19:10288:x1869752792281472:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2205us (2613us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1783135483.300594:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:3.0:1783135483.308908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.309573:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792281728 00000100:00100000:0.0:1783135483.309584:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792281728 00000100:00100000:0.0:1783135483.309649:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:0.0:1783135483.309660:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+19:10288:x1869752792281728:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135483.309684:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135483.309704:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875cc53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e4e expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.309870:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cc5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.309899:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cc5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.309910:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cc5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135483.309924:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1783135483.310056:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875cc53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e4e expref: 22 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.310073:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cc5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e4e expref: 21 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.310082:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f180c6800) 00010000:00010000:0.0:1783135483.310085:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135483.310088:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043a00, rc 0) 00000100:00100000:0.0:1783135483.311677:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+21:10288:x1869752792281728:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2011us (2771us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783135483.311687:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:0.0:1783135483.319901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.320249:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792281856 00000100:00100000:1.0:1783135483.320259:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792281856 00000100:00100000:1.0:1783135483.320406:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:1.0:1783135483.320417:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+21:2360:x1869752792281856:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135483.320432:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135483.320471:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cc45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e47 expref: 21 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.320501:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f180c6800) 00010000:00010000:1.0:1783135483.320508:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135483.320559:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+20:2360:x1869752792281856:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 144us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.320568:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:3.0:1783135483.326949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.327313:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792281984 00000100:00100000:0.0:1783135483.327324:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792281984 00000100:00100000:0.0:1783135483.327384:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:0.0:1783135483.327395:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792281984:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:0.0:1783135483.327457:0:8303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.327478:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.327497:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135483.327501:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135483.327506:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.327542:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.327556:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135483.327572:0:8303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8303:1869752813289472:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135483.328128:0:8303:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135483.340785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135483.341058:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792282112 00000100:00100000:2.0:1783135483.341071:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792282112 00002000:00100000:2.0:1783135483.341130:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8e8f1063c000 x1869752792282112/t0(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:654/0 lens 504/0 e 0 to 0 dl 1783135494 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135483.341141:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f1063c000 with x1869752792282112 ext(0->12) 00010000:00010000:2.0:1783135483.341150:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 8 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.341247:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 8 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135483.341257:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8f1063c000 00000100:00100000:2.0:1783135483.341301:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:2.0:1783135483.341312:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792282112:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:0.0:1783135483.342011:0:8303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8303:1869752813289472:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135483.342037:0:8303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783135483.384439:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000001:00080000:3.0:1783135483.452551:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1783135483.452878:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792282112:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 111563us (112098us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1783135483.452896:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00002000:00100000:1.0:1783135483.452912:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8e8f1063c000 x1869752792282112/t4294967299(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:654/0 lens 504/448 e 0 to 0 dl 1783135494 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783135483.452922:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f1063c000 with x1869752792282112 ext(0->12) 00010000:00010000:1.0:1783135483.452933:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.452953:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135483.452961:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8f1063c000 00000100:00100000:1.0:1783135483.460339:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.460412:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792282240 00000100:00100000:0.0:1783135483.460423:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792282240 00010000:00010000:0.0:1783135483.460467:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135483.460541:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 36 00000100:00100000:0.0:1783135483.460552:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792282240:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135483.460569:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783135483.460589:0:5782:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783135483.460592:0:5782:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783135482 00002000:00010000:0.0:1783135483.460594:0:5782:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783135483 00002000:00010000:0.0:1783135483.460596:0:5782:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783135482 00002000:00010000:0.0:1783135483.460598:0:5782:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1783135483.460603:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.460616:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.460641:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010be2e33/0xf646e0cda875cc1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e32 expref: 7 pid: 6587 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.460658:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135483.460662:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135483.460667:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.460677:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.460730:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135483.460793:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792282240:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 241us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135483.460801:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 36 00010000:00010000:1.0:1783135483.460859:0:8303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.460871:0:8303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.460903:0:8303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.460911:0:8303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.460920:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.460927:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135483.460931:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.460939:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.460950:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.460958:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9802321/0xf646e0cda875cc68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135483.461007:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792281984:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 133614us (134070us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.461015:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:3.0:1783135483.472099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135483.472553:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792282496 00000100:00100000:0.0:1783135483.472566:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792282496 00000100:00100000:0.0:1783135483.472647:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:0.0:1783135483.472659:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+20:10288:x1869752792282496:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:0.0:1783135483.472726:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cc5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e4e expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135483.473057:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1783135483.473104:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1783135483.473768:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1783135483.473876:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.473894:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 24 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.473901:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.473935:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 24 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.473949:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 24 pid: 9499 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135483.473974:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1869752813289600:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135483.474066:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135483.477399:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1869752813289600:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135483.477430:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135483.478641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.478765:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792282624 00000100:00100000:1.0:1783135483.478775:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792282624 00010000:00010000:1.0:1783135483.478858:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 25 pid: 9499 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135483.478899:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00100000:1.0:1783135483.478908:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+25:2361:x1869752792282624:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135483.478924:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135483.478932:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 25 pid: 9499 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.478944:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 25 pid: 9499 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.478966:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875cbff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e24 expref: 25 pid: 9499 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.478983:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f180c6800) 00010000:00010000:1.0:1783135483.478988:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.478997:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.479005:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.479026:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135483.479100:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+24:2361:x1869752792282624:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 192us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.479115:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 37 00010000:00010000:0.0:1783135483.479706:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135483.479716:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135483.479884:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1783135483.480090:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1783135483.480215:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813289728:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783135483.480312:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135483.480342:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135483.480456:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813289728 00000100:00100000:1.0:1783135483.480463:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813289728 00000100:00100000:1.0:1783135483.480509:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135483.480517:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1869752813289728:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783135483.480616:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1869752813289728:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.480624:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135483.480918:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813289728:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783135483.481590:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1783135483.482142:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f1063fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813289856:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135483.482340:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135483.482370:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f394dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135483.482810:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813289856 00000100:00100000:1.0:1783135483.482842:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813289856 00000100:00100000:1.0:1783135483.482887:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135483.482896:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5797:x1869752813289856:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783135483.483162:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5797:x1869752813289856:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 260us (816us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783135483.483170:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135483.483374:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f1063fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813289856:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1783135483.483441:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1783135483.483498:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135483.483510:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135483.483518:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135483.483525:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135483.483530:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135483.483538:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135483.483555:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f180c6800) 00010000:00010000:3.0:1783135483.483558:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1783135483.483563:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135483.483570:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cc6f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135483.488203:0:5797:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1783135483.488456:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1783135483.488469:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382917652749ns, next at 383917650106ns, rc = 0 00000001:00080000:3.0:1783135483.488480:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1783135483.488547:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f180c6800) 00010000:00010000:3.0:1783135483.488551:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783135483.488563:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875cc5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e4e expref: 28 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135483.488700:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+27:10288:x1869752792282496:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 16042us (16609us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1783135483.488711:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00000020:00080000:3.0:1783135483.488718:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783135483.493021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.493123:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792282752 00000100:00100000:1.0:1783135483.493133:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792282752 00000100:00100000:1.0:1783135483.493191:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:1.0:1783135483.493203:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+27:10288:x1869752792282752:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135483.493230:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135483.493255:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cc76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e55 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.493321:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cc76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e55 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.493352:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cc76 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e55 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.493375:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135483.493378:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135483.493382:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c200, rc 0) 00000100:00100000:1.0:1783135483.493441:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+28:10288:x1869752792282752:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 241us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.493450:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:1.0:1783135483.496909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135483.497076:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792283008 00000100:00100000:2.0:1783135483.497088:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792283008 00000100:00100000:2.0:1783135483.497145:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:2.0:1783135483.497156:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26324450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+28:10288:x1869752792283008:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1783135483.497412:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26324450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+29:10288:x1869752792283008:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 256us (512us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1783135483.497420:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:1.0:1783135483.611439:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135483.611550:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792283264 00000100:00100000:2.0:1783135483.611560:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792283264 00000100:00100000:2.0:1783135483.611627:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:2.0:1783135483.611636:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+29:10298:x1869752792283264:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135483.611659:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135483.611678:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cc7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e5c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135483.611800:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783135483.611949:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cc7d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e5c expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.611964:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:2.0:1783135483.611968:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135483.611974:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cc7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e5c expref: 31 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135483.611990:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2a00, rc 0) 00000100:00100000:2.0:1783135483.612066:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+30:10298:x1869752792283264:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 432us (638us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1783135483.612073:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:3.0:1783135483.619840:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.620329:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792283392 00000100:00100000:1.0:1783135483.620342:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792283392 00000100:00100000:1.0:1783135483.620445:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:1.0:1783135483.620457:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+30:10298:x1869752792283392:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:1.0:1783135483.620569:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.620605:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.620621:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.620637:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.620645:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.620669:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.620780:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.620799:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.620805:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135483.621023:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621040:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621046:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621054:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621060:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135483.621063:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621070:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621083:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135483.621094:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135483.621100:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621106:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cc8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621120:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621126:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621131:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621136:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135483.621138:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621144:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621151:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f10923000) 00010000:00010000:1.0:1783135483.621154:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135483.621156:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621162:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cc92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621177:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621190:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621195:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621200:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135483.621204:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621210:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621218:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135483.621220:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135483.621223:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.621229:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cc99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135483.621320:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+30:10298:x1869752792283392:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 863us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.621328:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:1.0:1783135483.624531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135483.624794:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792283648 00000100:00100000:2.0:1783135483.624805:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792283648 00000100:00100000:2.0:1783135483.624893:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:2.0:1783135483.624906:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+30:10298:x1869752792283648:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1783135483.625188:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+31:10298:x1869752792283648:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 284us (665us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1783135483.625197:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:2.0:1783135483.709293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.709402:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792283904 00000100:00100000:1.0:1783135483.709412:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792283904 00000100:00100000:1.0:1783135483.709479:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:1.0:1783135483.709499:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+31:10301:x1869752792283904:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135483.709542:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135483.709564:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cca0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e63 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709658:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709673:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709685:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709700:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709707:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709713:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709892:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709901:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.709908:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135483.709918:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783135483.710043:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710050:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710057:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710063:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135483.710068:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710076:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710089:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135483.710093:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135483.710097:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710104:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cca7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710116:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710122:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710129:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710145:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135483.710149:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710156:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710165:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f10923000) 00010000:00010000:1.0:1783135483.710167:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135483.710170:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710176:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875ccae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710223:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cca0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 34 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710239:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.710247:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135483.710249:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135483.710252:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d400, rc 0) 00000100:00100000:1.0:1783135483.710317:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+33:10301:x1869752792283904:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 820us (1033us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1783135483.710325:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:3.0:1783135483.716377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135483.716466:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792284032 00000100:00100000:1.0:1783135483.716504:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792284032 00000100:00100000:1.0:1783135483.716573:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:1.0:1783135483.716583:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+33:10301:x1869752792284032:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:1.0:1783135483.716671:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716688:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716700:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716730:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716737:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716744:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716750:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121de00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135483.716754:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716762:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716774:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135483.716777:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135483.716782:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135483.716800:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875ccc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135483.716914:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+33:10301:x1869752792284032:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 333us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135483.716923:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:3.0:1783135483.723212:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135483.723394:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792284288 00000100:00100000:2.0:1783135483.723406:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792284288 00000100:00100000:2.0:1783135483.723470:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:2.0:1783135483.723489:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+33:10301:x1869752792284288:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1783135483.723760:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+34:10301:x1869752792284288:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 281us (557us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1783135483.723768:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 11 00010000:00010000:0.0:1783135483.834098:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135484.059159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135484.059198:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792284544 00000100:00100000:2.0:1783135484.059208:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792284544 00000100:00100000:2.0:1783135484.059269:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 50 00000100:00100000:2.0:1783135484.059280:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+34:10333:x1869752792284544:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:2.0:1783135484.059305:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135484.059328:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ccca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e6a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.059451:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ccd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.059467:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.059494:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ccd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135484.059506:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00080000:1.0:1783135484.059800:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783135484.061206:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ccca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e6a expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.061234:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ccd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e6a expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.061243:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135484.061247:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135484.061257:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3e00, rc 0) 00000100:00100000:0.0:1783135484.061325:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+36:10333:x1869752792284544:12345-192.168.201.60@tcp:101:cat.0 Request processed in 2045us (2175us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1783135484.061334:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 50 00000100:00100000:0.0:1783135484.067029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135484.067057:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792284800 00000100:00100000:2.0:1783135484.067068:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792284800 00000100:00100000:0.0:1783135484.067074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135484.067112:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792284928 00000100:00100000:2.0:1783135484.067115:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:0.0:1783135484.067115:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792284928 00000100:00100000:2.0:1783135484.067124:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+37:10333:x1869752792284800:12345-192.168.201.60@tcp:35:cat.0 00000100:00100000:0.0:1783135484.067149:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:0.0:1783135484.067154:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+37:2361:x1869752792284928:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135484.067169:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135484.067194:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ccd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e6a expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.067212:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135484.067217:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135484.067268:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c88850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+36:2361:x1869752792284928:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 112us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135484.067288:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:2.0:1783135484.067403:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+36:10333:x1869752792284800:12345-192.168.201.60@tcp:35:cat.0 Request processed in 279us (385us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1783135484.067410:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 12 00000001:00080000:3.0:1783135484.101210:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967322 is committed 00000001:00080000:3.0:1783135484.101259:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967329 is committed 00000001:00080000:3.0:1783135484.101267:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:3.0:1783135484.101296:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1783135484.101315:0:5817:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8f394dd780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1783135484.101320:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f394d6c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f394dd3c0 00000020:00080000:3.0:1783135484.101323:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f394d6100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f012aa800 00000020:00080000:3.0:1783135484.101344:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1783135484.101503:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1783135484.101952:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813289984:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783135484.102031:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135484.102258:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813289984 00000100:00100000:1.0:1783135484.102266:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813289984 00000100:00100000:1.0:1783135484.102336:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135484.102346:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813289984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783135484.102381:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1783135484.102419:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a487cfa, atime: 0x6a487cfb, ctime: 0x6a487cfa, blocks: 0xb 00010000:00010000:1.0:1783135484.102428:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.102445:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1783135484.102449:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135484.102456:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.102473:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.102494:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.102516:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.102543:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135484.102936:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135484.102946:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.102956:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121de00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135484.102960:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.102970:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.102995:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.103003:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f546bdf/0xf646e0cda875ccdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.103025:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135484.103027:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135484.103029:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135484.109157:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813289984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6804us (7118us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783135484.109172:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:0.0:1783135484.113085:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f05733800/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783135484.113100:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813289984:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1783135484.159754:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135484.160180:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792285184 00000100:00100000:1.0:1783135484.160190:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792285184 00000100:00100000:1.0:1783135484.160256:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 51 00000100:00100000:1.0:1783135484.160265:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+14:10339:x1869752792285184:12345-192.168.201.60@tcp:101:dd.0 00010000:00010000:1.0:1783135484.160292:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135484.160295:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783135484.160325:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875cc37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e40 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.160349:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135484.160354:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135484.160366:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cce6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e71 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.160461:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.160486:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.160494:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.160547:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 14 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.160561:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 14 pid: 5796 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135484.160576:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813290112:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135484.160675:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052050c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135484.164768:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135484.164768:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813290112:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135484.164793:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135484.165560:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792285312 00000100:00100000:0.0:1783135484.165570:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792285312 00010000:00010000:0.0:1783135484.165609:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 15 pid: 5796 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135484.165698:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:0.0:1783135484.165708:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+15:2360:x1869752792285312:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135484.165724:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135484.165730:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 15 pid: 5796 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.165743:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 15 pid: 5796 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.165765:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ccb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e63 expref: 15 pid: 5796 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.165781:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135484.165786:0:11521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.165794:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.165801:0:11521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.165848:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135484.165910:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+14:2360:x1869752792285312:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 202us (1149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135484.165917:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 38 00010000:00010000:3.0:1783135484.166618:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.166629:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135484.166658:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783135484.167063:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875cce6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.167084:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.167093:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:3.0:1783135484.167096:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135484.167100:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d200, rc 0) 00000100:00100000:3.0:1783135484.167193:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+14:10339:x1869752792285184:12345-192.168.201.60@tcp:101:dd.0 Request processed in 6927us (7448us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1783135484.167202:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 51 00000100:00100000:2.0:1783135484.170449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135484.170562:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792285568 00000100:00100000:1.0:1783135484.170569:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792285568 00000100:00100000:1.0:1783135484.170663:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 52 00000100:00100000:1.0:1783135484.170672:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+14:10339:x1869752792285568:12345-192.168.201.60@tcp:36:dd.0 00010000:00010000:1.0:1783135484.170973:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.170986:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.170994:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135484.171031:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1783135484.171046:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000043cf103 reply state 00000000298e233a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135484.171060:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135484.171135:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+17:10339:x1869752792285568:12345-192.168.201.60@tcp:36:dd.0 Request processed in 464us (696us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1783135484.171140:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 52 00000020:00080000:1.0:1783135484.171144:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783135484.174196:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.174212:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.174219:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.174225:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135484.174242:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.174249:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.174267:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:2.0:1783135484.174270:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135484.174373:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135484.174381:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875ccfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135484.527519:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135484.527841:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792285696 00000100:00100000:0.0:1783135484.527868:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792285696 00000100:00100000:0.0:1783135484.527946:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 53 00000100:00100000:0.0:1783135484.527958:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+16:10353:x1869752792285696:12345-192.168.201.60@tcp:101:stat.0 00010000:00010000:0.0:1783135484.527984:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135484.528003:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cd02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e78 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528079:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528094:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528106:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528121:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528128:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528133:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528884:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528901:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528909:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528956:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.528970:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 17 pid: 5794 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135484.528985:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813290240:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135484.529095:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38de40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135484.533421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135484.533915:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813290240:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135484.533944:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135484.534029:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792285952 00000100:00100000:2.0:1783135484.534037:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792285952 00000100:00100000:2.0:1783135484.534109:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:2.0:1783135484.534119:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+18:5576:x1869752792285952:12345-192.168.201.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783135484.534491:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+19:5576:x1869752792285952:12345-192.168.201.60@tcp:35:ldlm_bl.0 Request processed in 372us (1079us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1783135484.534500:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:2.0:1783135484.541477:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135484.541562:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792286080 00000100:00100000:3.0:1783135484.541571:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792286080 00010000:00010000:3.0:1783135484.541675:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 19 pid: 5794 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135484.541792:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:3.0:1783135484.541802:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+19:2360:x1869752792286080:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135484.541843:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135484.541851:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 19 pid: 5794 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.541864:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 19 pid: 5794 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.541904:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875cced lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e71 expref: 19 pid: 5794 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.541920:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:3.0:1783135484.541927:0:6604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.541936:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.541943:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.541973:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135484.542042:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+18:2360:x1869752792286080:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 241us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135484.542050:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 39 00010000:00010000:1.0:1783135484.543687:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543703:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135484.543762:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783135484.543767:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135484.543868:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543883:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543894:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543900:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543906:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543923:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135484.543927:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543934:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543947:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135484.543950:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135484.543954:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543959:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875cd09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543974:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543980:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543986:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543990:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135484.543993:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.543999:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.544015:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f1a154b00) 00010000:00010000:1.0:1783135484.544018:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135484.544021:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.544026:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875cd10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.544068:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cd02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e78 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.544082:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e78 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135484.544089:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135484.544091:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135484.544093:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042a00, rc 0) 00000100:00100000:1.0:1783135484.544168:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+17:10353:x1869752792285696:12345-192.168.201.60@tcp:101:stat.0 Request processed in 16200us (16648us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135484.544176:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 53 00000100:00100000:2.0:1783135484.653939:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135484.654041:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792286336 00000100:00100000:0.0:1783135484.654051:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792286336 00000100:00100000:0.0:1783135484.654114:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 54 00000100:00100000:0.0:1783135484.654125:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+17:10359:x1869752792286336:12345-192.168.201.60@tcp:36:truncate.0 00010000:00010000:0.0:1783135484.654183:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135484.654214:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cd17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e78 expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.654234:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135484.654240:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135484.654476:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.654490:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.654500:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135484.654570:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1783135484.654593:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5314b05 reply state 00000000ba6c807c transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135484.654600:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135484.654714:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+19:10359:x1869752792286336:12345-192.168.201.60@tcp:36:truncate.0 Request processed in 589us (784us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1783135484.654721:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 54 00000020:00080000:0.0:1783135484.654727:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783135484.657198:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.657216:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.657223:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.657229:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135484.657234:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.657241:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.657258:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135484.657261:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135484.657267:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.657273:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135484.830672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135484.830878:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792286464 00000100:00100000:3.0:1783135484.830888:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792286464 00000100:00100000:3.0:1783135484.830946:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 55 00000100:00100000:3.0:1783135484.830957:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+18:10373:x1869752792286464:12345-192.168.201.60@tcp:101:stat.0 00010000:00010000:3.0:1783135484.830983:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135484.831002:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cd25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e7f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831064:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831097:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831109:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831122:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831129:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831136:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831648:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831659:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831667:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135484.831703:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1783135484.831707:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135484.831726:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831737:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831755:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831903:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831913:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831919:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135484.831923:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831931:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831944:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:3.0:1783135484.831947:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135484.831951:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831957:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cd2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831970:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831976:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831982:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.831993:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135484.831996:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.832002:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.832009:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f08840100) 00010000:00010000:3.0:1783135484.832011:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135484.832014:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.832020:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.832052:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cd25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.832063:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135484.832071:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:3.0:1783135484.832073:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135484.832076:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487800, rc 0) 00000100:00100000:3.0:1783135484.832140:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+19:10373:x1869752792286464:12345-192.168.201.60@tcp:101:stat.0 Request processed in 1185us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135484.832207:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 55 00010000:00010000:2.0:1783135484.858078:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135484.919068:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135484.919162:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792286720 00000100:00100000:0.0:1783135484.919171:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792286720 00000100:00100000:0.0:1783135484.919225:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 56 00000100:00100000:0.0:1783135484.919234:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+19:10383:x1869752792286720:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135484.919253:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135484.919288:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e86 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135484.919576:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1783135484.919745:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd41 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e86 expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.920080:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:0.0:1783135484.920085:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135484.920091:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e86 expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135484.920108:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043600, rc 0) 00000100:00100000:0.0:1783135484.920213:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+20:10383:x1869752792286720:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 978us (1153us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1783135484.920221:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 56 00000100:00100000:2.0:1783135484.923982:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135484.924088:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792286976 00000100:00100000:0.0:1783135484.924100:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792286976 00000100:00100000:0.0:1783135484.924159:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:0.0:1783135484.924170:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+20:10383:x1869752792286976:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135484.926175:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+21:10383:x1869752792286976:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1997us (2193us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1783135484.926196:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:2.0:1783135485.027911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.028035:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792287232 00000100:00100000:1.0:1783135485.028045:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792287232 00000100:00100000:1.0:1783135485.028113:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:1.0:1783135485.028124:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+21:10389:x1869752792287232:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1783135485.028160:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135485.028183:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cd4f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e8d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.028295:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.028311:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 22 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.028320:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.028356:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 22 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.028371:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 22 pid: 5794 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.028388:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813290368:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135485.028492:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135485.031635:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135485.031741:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792287360 00000100:00100000:0.0:1783135485.031751:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792287360 00010000:00010000:0.0:1783135485.031790:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 23 pid: 5794 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135485.031861:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 40 00000100:00100000:0.0:1783135485.031870:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+23:2361:x1869752792287360:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135485.031885:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135485.031892:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 23 pid: 5794 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.031906:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 23 pid: 5794 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.031929:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135485.031935:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.031946:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.031954:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.031974:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135485.032037:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+23:2361:x1869752792287360:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 167us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135485.032062:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 40 00010000:00010000:1.0:1783135485.032904:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875cd3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e7f expref: 22 pid: 5794 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.032926:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813290368:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135485.032949:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.032960:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.032982:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135485.033002:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1783135485.033162:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cd4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 23 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.033179:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 22 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.033186:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135485.033189:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135485.033192:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c600, rc 0) 00000100:00100000:1.0:1783135485.033233:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+22:10389:x1869752792287232:12345-192.168.201.60@tcp:101:bash.0 Request processed in 5110us (5333us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1783135485.033241:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:2.0:1783135485.037152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.037238:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792287616 00000100:00100000:1.0:1783135485.037256:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792287616 00000100:00100000:1.0:1783135485.037316:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 58 00000100:00100000:1.0:1783135485.037327:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+22:10389:x1869752792287616:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1783135485.037750:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.037774:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.037785:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135485.037896:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1783135485.037920:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000316bc064 reply state 000000000872166b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.037929:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135485.038032:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+25:10389:x1869752792287616:12345-192.168.201.60@tcp:36:bash.0 Request processed in 706us (889us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1783135485.038039:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 58 00000020:00080000:1.0:1783135485.038045:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783135485.047675:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.047695:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.047703:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.047710:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121da00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135485.047715:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.047735:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.047753:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:2.0:1783135485.047757:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135485.047772:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.047778:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875cd64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135485.051231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135485.052082:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792287744 00000100:00100000:3.0:1783135485.052111:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792287744 00000100:00100000:3.0:1783135485.052175:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 59 00000100:00100000:3.0:1783135485.052187:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+24:10389:x1869752792287744:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1783135485.052212:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135485.052234:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cd6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e94 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.052338:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.052356:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 25 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.052366:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.052404:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 25 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.052419:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 25 pid: 5795 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135485.052434:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f1063d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813290496:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135485.052579:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08412240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135485.060885:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f1063d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813290496:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135485.060916:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135485.062066:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135485.062265:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792287872 00000100:00100000:0.0:1783135485.062274:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792287872 00010000:00010000:0.0:1783135485.062313:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 26 pid: 5795 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135485.062359:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:0.0:1783135485.062370:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+26:2361:x1869752792287872:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135485.062384:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135485.062392:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 26 pid: 5795 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.062404:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 26 pid: 5795 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.062438:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cd56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e8d expref: 26 pid: 5795 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.062466:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135485.062472:0:11521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.062481:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.062489:0:11521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.062529:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135485.062589:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+25:2361:x1869752792287872:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 220us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135485.062597:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 41 00010000:00010000:3.0:1783135485.062796:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.062804:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135485.062901:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783135485.062906:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135485.062931:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.062964:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875cd6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e94 expref: 25 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.062978:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e94 expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.062986:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:3.0:1783135485.062989:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135485.062992:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487200, rc 0) 00000100:00100000:3.0:1783135485.063020:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+24:10389:x1869752792287744:12345-192.168.201.60@tcp:101:bash.0 Request processed in 10836us (11799us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135485.063027:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 59 00000100:00100000:3.0:1783135485.072318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135485.072563:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792288128 00000100:00100000:2.0:1783135485.072574:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792288128 00000100:00100000:2.0:1783135485.072635:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:2.0:1783135485.072646:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26324c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+24:10389:x1869752792288128:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1783135485.072963:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26324c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+25:10389:x1869752792288128:12345-192.168.201.60@tcp:35:bash.0 Request processed in 317us (654us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1783135485.072971:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:2.0:1783135485.163287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.163575:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792288384 00000100:00100000:1.0:1783135485.163587:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792288384 00000100:00100000:1.0:1783135485.163707:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 60 00000100:00100000:1.0:1783135485.163719:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+25:10399:x1869752792288384:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135485.163747:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135485.163779:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cd79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11e9b expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135485.164080:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1783135485.164371:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cd79 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e9b expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.164386:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:1.0:1783135485.164389:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135485.164404:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cd79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e9b expref: 27 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.164426:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d800, rc 0) 00000100:00100000:1.0:1783135485.164580:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+26:10399:x1869752792288384:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 863us (1303us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1783135485.164589:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 60 00000100:00100000:3.0:1783135485.169434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.169577:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792288512 00000100:00100000:1.0:1783135485.169587:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792288512 00000100:00100000:1.0:1783135485.169653:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:1.0:1783135485.169664:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+26:10399:x1869752792288512:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:1.0:1783135485.169737:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.169753:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.169775:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.169790:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.169796:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.169802:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170195:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170211:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170219:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135485.170261:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170274:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170280:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170287:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170294:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.170298:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170307:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170318:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135485.170321:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.170325:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170331:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cd87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170351:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170357:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170363:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170368:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121dc00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.170371:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170376:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170385:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f10923500) 00010000:00010000:1.0:1783135485.170387:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.170390:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170395:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cd8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170410:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170415:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170434:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170445:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.170448:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170453:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170472:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135485.170474:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.170477:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.170481:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cd95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.170574:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+26:10399:x1869752792288512:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 911us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.170586:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:3.0:1783135485.173617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135485.173769:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792288768 00000100:00100000:2.0:1783135485.173778:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792288768 00000100:00100000:2.0:1783135485.173862:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:2.0:1783135485.173874:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+26:10399:x1869752792288768:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1783135485.174343:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+27:10399:x1869752792288768:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 469us (733us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1783135485.174351:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:2.0:1783135485.235226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135485.235414:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792289024 00000100:00100000:0.0:1783135485.235434:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792289024 00000100:00100000:0.0:1783135485.235510:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 62 00000100:00100000:0.0:1783135485.235520:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+27:10402:x1869752792289024:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135485.235545:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135485.235566:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ea2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.235639:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.235652:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.235663:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.235675:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.235681:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.235687:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236096:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042800/0xf646e0cda875cdb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236106:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042800/0xf646e0cda875cdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236112:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042800/0xf646e0cda875cdb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135485.236122:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783135485.236210:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236218:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236224:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236229:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135485.236233:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236240:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236254:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:0.0:1783135485.236257:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135485.236261:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236848:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875cda3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236863:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236869:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236875:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236880:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135485.236883:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236889:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236898:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f1a154600) 00010000:00010000:0.0:1783135485.236900:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135485.236903:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236909:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875cdaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236954:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cd9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ea2 expref: 30 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236967:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042800/0xf646e0cda875cdb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ea2 expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.236982:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135485.236985:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135485.236988:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042800, rc 0) 00000100:00100000:0.0:1783135485.237063:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+29:10402:x1869752792289024:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1545us (1847us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1783135485.237071:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 62 00000100:00100000:3.0:1783135485.242166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.242254:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792289152 00000100:00100000:1.0:1783135485.242264:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792289152 00000100:00100000:1.0:1783135485.242339:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:1.0:1783135485.242350:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+29:2361:x1869752792289152:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135485.242367:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135485.242391:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042800/0xf646e0cda875cdb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ea2 expref: 29 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.242416:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135485.242422:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135485.242506:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+28:2361:x1869752792289152:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 157us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.242514:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:3.0:1783135485.257114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.257171:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792289280 00000100:00100000:1.0:1783135485.257181:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792289280 00000100:00100000:1.0:1783135485.257241:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 63 00000100:00100000:1.0:1783135485.257250:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+28:10402:x1869752792289280:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:1.0:1783135485.257329:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257347:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257359:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257385:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257393:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257399:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257406:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.257410:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257428:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257468:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135485.257471:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135485.257476:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.257482:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.257556:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+28:10402:x1869752792289280:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 306us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.257563:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 63 00000100:00100000:3.0:1783135485.261592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135485.261863:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792289536 00000100:00100000:2.0:1783135485.261873:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792289536 00000100:00100000:2.0:1783135485.261931:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:2.0:1783135485.261943:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+28:10402:x1869752792289536:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1783135485.262192:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+29:10402:x1869752792289536:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 250us (609us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1783135485.262201:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:2.0:1783135485.520586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.520706:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792289792 00000100:00100000:1.0:1783135485.520716:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792289792 00000100:00100000:1.0:1783135485.520788:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00100000:1.0:1783135485.520798:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+29:10420:x1869752792289792:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:1.0:1783135485.520862:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135485.520885:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ea9 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.520992:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cdcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.521007:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cdcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.521018:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cdcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135485.521029:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783135485.521187:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ea9 expref: 32 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.521206:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cdcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ea9 expref: 31 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.521214:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135485.521217:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783135485.521221:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121dc00, rc 0) 00000100:00100000:1.0:1783135485.521283:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+31:10420:x1869752792289792:12345-192.168.201.60@tcp:101:cat.0 Request processed in 487us (708us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1783135485.521290:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00100000:2.0:1783135485.563878:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135485.563900:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813290624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135485.563973:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135485.564155:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813290624 00000100:00100000:0.0:1783135485.564162:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813290624 00000100:00100000:0.0:1783135485.564228:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783135485.564239:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813290624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135485.564286:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135485.564342:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813290624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135485.564349:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783135485.564465:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813290624:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783135485.564633:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135485.586919:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.587027:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792289920 00000100:00100000:1.0:1783135485.587040:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792289920 00000100:00100000:1.0:1783135485.587092:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 65 00000100:00100000:1.0:1783135485.587102:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+31:10421:x1869752792289920:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135485.587126:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135485.587146:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cddb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11eb0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.587210:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cde2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.587223:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cde2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.587235:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cde2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135485.587473:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783135485.587479:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135485.587558:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cde2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.587584:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb0 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.587601:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cde2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb0 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.587610:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135485.587613:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135485.587617:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d600, rc 0) 00000100:00100000:1.0:1783135485.587684:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+32:10421:x1869752792289920:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 583us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.587692:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 65 00000100:00100000:3.0:1783135485.592262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135485.592404:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792290304 00000100:00100000:2.0:1783135485.592458:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792290304 00000100:00100000:2.0:1783135485.592536:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:2.0:1783135485.592547:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+32:10421:x1869752792290304:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1783135485.592956:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+33:10421:x1869752792290304:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 408us (707us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1783135485.592966:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:2.0:1783135485.604153:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135485.604606:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792290432 00000100:00100000:3.0:1783135485.604625:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792290432 00000100:00100000:3.0:1783135485.604855:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:3.0:1783135485.604870:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+33:10421:x1869752792290432:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:3.0:1783135485.604892:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783135485.604928:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875cd72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e94 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.604958:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cdcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ea9 expref: 32 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.604972:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cc76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e55 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.604985:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:3.0:1783135485.604998:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135485.605077:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+30:10421:x1869752792290432:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 211us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135485.605085:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:3.0:1783135485.614292:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135485.614704:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792290560 00000100:00100000:0.0:1783135485.614718:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792290560 00000100:00100000:0.0:1783135485.614810:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 66 00000100:00100000:0.0:1783135485.614851:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+30:10421:x1869752792290560:12345-192.168.201.60@tcp:58:lfs.0 00010000:00010000:0.0:1783135485.615025:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.615046:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.615061:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135485.623917:0:9499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135485.624256:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783135485.626075:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783135485.628141:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+30:10421:x1869752792290560:12345-192.168.201.60@tcp:58:lfs.0 Request processed in 13272us (13853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135485.628164:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 66 00000100:00100000:2.0:1783135485.681055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.681174:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792290688 00000100:00100000:1.0:1783135485.681188:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792290688 00000100:00100000:1.0:1783135485.681278:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 67 00000100:00100000:1.0:1783135485.681290:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+30:10423:x1869752792290688:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135485.681318:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135485.681344:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdf0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11eb7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.681616:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.681656:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.681671:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.681688:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.681695:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.681700:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682246:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682253:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682259:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135485.682314:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783135485.682318:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135485.682338:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682349:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682499:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682507:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682515:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682521:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.682526:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682535:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682551:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135485.682554:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.682560:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682566:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cdf7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682581:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682587:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682593:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682605:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.682608:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682614:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682623:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f10923500) 00010000:00010000:1.0:1783135485.682626:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.682628:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682634:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cdfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682665:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875cdf0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682678:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 31 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.682684:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:1.0:1783135485.682686:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135485.682688:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121ce00, rc 0) 00000100:00100000:1.0:1783135485.682762:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+31:10423:x1869752792290688:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1474us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.682772:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 67 00000040:00080000:0.0:1783135485.818529:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135485.818541:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135485.818597:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1783135485.818605:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135485.818791:0:11538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db58000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813290752:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135485.818957:0:11538:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d780 going to sleep for 11 seconds 00000100:00100000:3.0:1783135485.829243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135485.829564:0:11538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db58000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813290752:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135485.830937:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792290816 00000100:00100000:1.0:1783135485.830976:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792290816 00000100:00100000:1.0:1783135485.831050:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:1.0:1783135485.831063:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0c7819a6-778a-4617-af33-00460db74182+31:10434:x1869752792290816:12345-192.168.201.60@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783135485.831193:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0c7819a6-778a-4617-af33-00460db74182+31:10434:x1869752792290816:12345-192.168.201.60@tcp:900:lhsmtool_posix.0 Request processed in 132us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.831201:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:3.0:1783135485.839112:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135485.839345:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792290944 00000100:00100000:0.0:1783135485.839358:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792290944 00000100:00100000:0.0:1783135485.839437:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 68 00000100:00100000:0.0:1783135485.839461:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+31:10434:x1869752792290944:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135485.839511:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135485.839655:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+31:10434:x1869752792290944:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 207us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135485.839664:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 68 00000100:00100000:3.0:1783135485.848652:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.849239:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792291072 00000100:00100000:1.0:1783135485.849255:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792291072 00000100:00100000:1.0:1783135485.849332:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:1.0:1783135485.849345:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+31:10434:x1869752792291072:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783135485.849468:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849491:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849506:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849704:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849740:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849752:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849796:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849879:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849887:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135485.849941:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783135485.849945:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135485.849965:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849979:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849984:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849991:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.849997:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.850000:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.850008:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.850020:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:1.0:1783135485.850023:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.850027:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.850047:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce0c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.850066:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.850071:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.850077:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.850081:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.851420:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851607:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851626:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8e8f10923500) 00010000:00010000:1.0:1783135485.851629:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.851634:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851642:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce13 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851671:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851678:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851703:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851709:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.851712:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851728:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851737:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:1.0:1783135485.851740:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.851742:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.851747:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875ce1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.852432:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+31:10434:x1869752792291072:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 Request processed in 3083us (3788us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.852456:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:3.0:1783135485.866779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135485.866904:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792291328 00000100:00100000:2.0:1783135485.866917:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792291328 00000100:00100000:2.0:1783135485.867003:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:2.0:1783135485.867015:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+31:10434:x1869752792291328:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135485.867043:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135485.867072:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875ce21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ebe expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868292:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868321:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868337:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135485.868351:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783135485.868500:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868520:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868527:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868534:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135485.868539:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868548:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868562:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:2.0:1783135485.868565:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135485.868572:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135485.868578:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875ce28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.868847:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875ce21 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ebe expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.868862:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:3.0:1783135485.868865:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135485.868877:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875ce21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ebe expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.868891:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2400, rc 0) 00000100:00100000:3.0:1783135485.868985:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+32:10434:x1869752792291328:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 1972us (2219us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1783135485.868995:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:3.0:1783135485.875917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.876175:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792291456 00000100:00100000:1.0:1783135485.876188:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792291456 00000100:00100000:1.0:1783135485.876268:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 71 00000100:00100000:1.0:1783135485.876282:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+32:10434:x1869752792291456:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783135485.876368:0:5794:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783135485.876549:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+32:10434:x1869752792291456:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 269us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.876571:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 71 00000100:00100000:2.0:1783135485.880674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135485.881115:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792291712 00000100:00100000:3.0:1783135485.881130:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792291712 00000100:00100000:3.0:1783135485.881210:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 72 00000100:00100000:3.0:1783135485.881224:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+32:10434:x1869752792291712:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135485.881270:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135485.881274:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135485.881313:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cde2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb0 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.881336:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:3.0:1783135485.881342:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135485.881357:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce36 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ec5 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.882117:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783135485.882706:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1783135485.886107:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875ce3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.886148:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875ce3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.886186:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875ce3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.886284:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce36 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ec5 expref: 34 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.886308:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875ce3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ec5 expref: 33 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.886320:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135485.886323:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135485.886327:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486a00, rc 0) 00000100:00100000:3.0:1783135485.887649:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+33:10434:x1869752792291712:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 6410us (6972us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1783135485.887671:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 72 00000100:00100000:3.0:1783135485.897057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.897305:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792291968 00000100:00100000:1.0:1783135485.897319:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792291968 00000100:00100000:1.0:1783135485.897432:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 73 00000100:00100000:1.0:1783135485.897455:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+33:10434:x1869752792291968:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135485.897801:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135485.897894:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875ce3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ec5 expref: 33 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.897919:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:1.0:1783135485.897935:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135485.897966:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.897983:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.897994:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898131:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898156:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898168:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898860:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898871:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898877:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898883:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.898887:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898894:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898911:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135485.898915:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.898920:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898926:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898939:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898946:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898952:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898964:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135485.898968:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898974:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898983:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1fbf6fc2 (ffff8e8f10923500) 00010000:00010000:1.0:1783135485.898987:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135485.898990:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.898996:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce52 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1fbf6fc2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.899117:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+32:10434:x1869752792291968:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 1670us (2072us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135485.899127:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 73 00000100:00100000:1.0:1783135485.901894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135485.902095:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792292096 00000100:00100000:3.0:1783135485.902104:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792292096 00000100:00100000:3.0:1783135485.902196:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 74 00000100:00100000:3.0:1783135485.902206:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+32:10434:x1869752792292096:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135485.902225:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135485.902250:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875ce59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ecc expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.902285:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.902524:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.902538:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.902659:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875ce59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 34 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.902682:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135485.902690:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:3.0:1783135485.902693:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135485.902697:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487c00, rc 0) 00000100:00100000:3.0:1783135485.902769:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+33:10434:x1869752792292096:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 565us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135485.902778:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 74 00000100:00100000:3.0:1783135485.918888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.918998:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792292352 00000100:00100000:1.0:1783135485.919009:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792292352 00000100:00100000:1.0:1783135485.919065:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 75 00000100:00100000:1.0:1783135485.919075:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+33:10434:x1869752792292352:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135485.919167:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.919186:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.919217:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135485.919652:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1783135485.919665:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385348848529ns, next at 386348846407ns, rc = 0 00000004:00010000:1.0:1783135485.920418:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000714d6386 reply state 00000000dd0240ea transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.920432:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135485.920917:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+35:10434:x1869752792292352:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 1838us (2188us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1783135485.920934:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 75 00000100:00100000:3.0:1783135485.925881:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135485.925932:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792292480 00000100:00100000:1.0:1783135485.925942:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792292480 00000100:00100000:1.0:1783135485.926005:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 76 00000100:00100000:1.0:1783135485.926016:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+35:10434:x1869752792292480:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135485.926040:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135485.926061:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ed3 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.926120:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 36 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.926134:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 36 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135485.926153:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:1.0:1783135485.926168:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135485.926172:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c800, rc 0) 00000100:00100000:1.0:1783135485.926228:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+36:10434:x1869752792292480:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 215us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.926236:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 76 00010000:00010000:0.0:1783135485.929801:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.929835:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.929869:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.929875:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135485.929880:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.929889:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.929909:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:0.0:1783135485.929914:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135485.929920:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135485.929927:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875ce67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135485.930169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135485.930316:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792292608 00000100:00100000:0.0:1783135485.930327:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792292608 00000100:00100000:0.0:1783135485.930379:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:0.0:1783135485.930388:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1869752792292608:12345-192.168.201.60@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1783135485.930420:0:6589:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:0.0:1783135485.930465:0:6589:0:(genops.c:1406:class_connect()) connect: client 0c7819a6-778a-4617-af33-00460db74182, cookie 0xf646e0cda875ce75 00002000:00100000:0.0:1783135485.930478:0:6589:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0c7819a6-778a-4617-af33-00460db74182/ffff8e8f3c270000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135485.930509:0:6589:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135485.930772:0:6589:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783135485.930812:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c277000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135485.931029:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2359:x1869752792292608:12345-192.168.201.60@tcp:8:lhsmtool_posix.0 Request processed in 634us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135485.931042:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:3.0:1783135485.942646:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135485.942746:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792292736 00000100:00100000:0.0:1783135485.942762:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792292736 00000100:00100000:0.0:1783135485.942901:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 26 00000100:00100000:0.0:1783135485.942912:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+6:0:x1869752792292736:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1783135485.943272:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135486.009799:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:0:x1869752792292736:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 66877us (67156us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1783135486.009848:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 26 00000001:00080000:2.0:1783135486.009886:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:2.0:1783135486.009895:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000100:00100000:2.0:1783135486.018678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.018748:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792292992 00000100:00100000:0.0:1783135486.018757:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792292992 00000100:00100000:0.0:1783135486.018851:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:0.0:1783135486.018862:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+35:10434:x1869752792292992:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783135486.019106:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+36:10434:x1869752792292992:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 245us (437us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1783135486.019113:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00080000:2.0:1783135486.019239:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135486.023797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.023903:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792293248 00000100:00100000:3.0:1783135486.023914:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792293248 00000100:00100000:3.0:1783135486.023975:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 77 00000100:00100000:3.0:1783135486.023984:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+36:10434:x1869752792293248:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783135486.024096:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+36:10434:x1869752792293248:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 113us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135486.024114:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 77 00000100:00100000:3.0:1783135486.026563:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135486.028516:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792293376 00000100:00100000:2.0:1783135486.028531:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792293376 00000100:00100000:2.0:1783135486.028802:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 78 00000100:00100000:2.0:1783135486.028839:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+36:10434:x1869752792293376:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135486.028865:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135486.028890:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875ce7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11eda expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.028996:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ce83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.029011:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ce83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.029023:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ce83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135486.029063:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135486.029085:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ce83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.029111:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875ce7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eda expref: 38 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.029130:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ce83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eda expref: 37 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.029139:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:2.0:1783135486.029142:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783135486.029153:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3e00, rc 0) 00000100:00100000:2.0:1783135486.029224:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+37:10434:x1869752792293376:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 411us (2669us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.029232:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 78 00000100:00100000:0.0:1783135486.032318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135486.032405:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792293504 00000100:00100000:1.0:1783135486.032415:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792293504 00000100:00100000:1.0:1783135486.032507:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 27 00000100:00100000:1.0:1783135486.032517:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792293504:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135486.032536:0:8303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135486.032567:0:8303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ee1 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135486.032594:0:8303:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487cfd, blocks: 0x1 00010000:00010000:1.0:1783135486.032615:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1783135486.032618:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135486.032628:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 6 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.032645:0:8303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 6 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.032676:0:8303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c200, rc 0) 00000100:00100000:1.0:1783135486.032739:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792293504:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 223us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135486.032755:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 27 00000100:00100000:3.0:1783135486.036229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135486.036310:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792293760 00000100:00100000:1.0:1783135486.036319:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792293760 00000100:00100000:1.0:1783135486.036395:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:1.0:1783135486.036405:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+37:10434:x1869752792293760:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783135486.036560:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+37:10434:x1869752792293760:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 156us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135486.036567:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:0.0:1783135486.041762:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.041901:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792293888 00000100:00100000:3.0:1783135486.041911:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792293888 00000100:00100000:3.0:1783135486.041965:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:3.0:1783135486.041974:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:10434:x1869752792293888:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135486.041991:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135486.042011:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ee8 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.042041:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 7 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.042051:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135486.042055:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135486.042060:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.042098:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 7 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.042111:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 7 pid: 8303 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.042126:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813290880:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135486.042240:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08412240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135486.046384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.047070:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813290880:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135486.047107:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.047130:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486200, rc 0) 00000100:00100000:0.0:1783135486.047268:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792294016 00000100:00100000:0.0:1783135486.047276:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792294016 00010000:00010000:0.0:1783135486.047311:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 8 pid: 8303 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135486.047353:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:0.0:1783135486.047361:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+8:2361:x1869752792294016:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135486.047377:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135486.047398:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 8 pid: 8303 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.047410:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 8 pid: 8303 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.047465:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa8ae55b/0xf646e0cda875ce8a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee1 expref: 8 pid: 8303 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.047482:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135486.047486:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135486.047495:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.047506:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.047556:0:5780:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135486.047571:0:5780:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5780:1869752813291008:192.168.201.60@tcp:105: 00000100:00100000:0.0:1783135486.047661:0:5780:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02cc0a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135486.049945:0:5780:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5780:1869752813291008:192.168.201.60@tcp:105: 00010000:00010000:0.0:1783135486.049976:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135486.050022:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c8b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792294016:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 2661us (3648us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.050034:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:2.0:1783135486.051562:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:10434:x1869752792293888:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 9581us (9812us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.051575:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:1.0:1783135486.056551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.056663:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792294144 00000100:00100000:0.0:1783135486.056674:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792294144 00002000:00100000:0.0:1783135486.056725:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e8f05730000 x1869752792294144/t0(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:657/0 lens 504/0 e 0 to 0 dl 1783135497 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135486.056760:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f05730000 with x1869752792294144 ext(0->8) 00002000:00010000:0.0:1783135486.056767:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f05730000 00000100:00100000:0.0:1783135486.056801:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:0.0:1783135486.056811:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792294144:12345-192.168.201.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783135486.057530:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792294144:12345-192.168.201.60@tcp:4:lhsmtool_posix.0 Request processed in 717us (999us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1783135486.057540:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00002000:00100000:0.0:1783135486.057548:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8e8f05730000 x1869752792294144/t4294967302(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:657/0 lens 504/448 e 0 to 0 dl 1783135497 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135486.057557:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f05730000 with x1869752792294144 ext(0->8) 00002000:00010000:0.0:1783135486.057561:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f05730000 00000100:00100000:0.0:1783135486.060985:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.061082:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792294272 00000100:00100000:3.0:1783135486.061093:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792294272 00000100:00100000:3.0:1783135486.061151:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 80 00000100:00100000:3.0:1783135486.061161:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+37:10434:x1869752792294272:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1783135486.123170:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1783135486.123216:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:2.0:1783135486.123368:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813291136:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783135486.123450:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135486.123529:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813291136 00000100:00100000:2.0:1783135486.123547:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813291136 00000100:00100000:2.0:1783135486.124016:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135486.124029:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813291136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783135486.124193:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783135486.124196:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783135485 00002000:00010000:2.0:1783135486.124198:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783135486.124200:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783135485 -> 1783135485 00002000:00010000:2.0:1783135486.124203:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783135486.124298:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813291136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 272us (857us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1783135486.124306:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1783135486.124330:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00080000:2.0:1783135486.124390:0:5817:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1783135486.124404:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1783135486.124417:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1783135486.124559:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+13:10434:x1869752792294272:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 Request processed in 63397us (63582us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.124568:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 80 00000004:00080000:3.0:1783135486.129507:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f3c3c1f80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1783135486.129522:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813291136:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783135486.132795:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.132854:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792294400 00000100:00100000:0.0:1783135486.132865:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792294400 00000100:00100000:0.0:1783135486.132920:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 30 00000100:00100000:0.0:1783135486.132930:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+8:2363:x1869752792294400:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1783135486.190480:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:1.0:1783135486.190510:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1783135486.192467:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792294400:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 Request processed in 59527us (59671us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.192481:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 30 00000100:00100000:2.0:1783135486.198698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.198972:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792294656 00000100:00100000:3.0:1783135486.198983:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792294656 00000100:00100000:3.0:1783135486.199050:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 81 00000100:00100000:3.0:1783135486.199061:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+13:10434:x1869752792294656:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135486.199116:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135486.199145:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ce83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eda expref: 13 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.199166:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:3.0:1783135486.199171:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135486.199202:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.199217:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.199240:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135486.199509:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e1937359 reply state 0000000098747f6d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.199518:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783135486.199622:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+14:10434:x1869752792294656:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 563us (936us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1783135486.199630:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 81 00010000:00010000:3.0:1783135486.208257:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.208276:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.208285:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.208291:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135486.208297:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.208305:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.208323:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:3.0:1783135486.208326:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135486.208330:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.208349:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875ce98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.209629:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.209717:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792294784 00000100:00100000:0.0:1783135486.209726:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792294784 00000100:00100000:0.0:1783135486.209784:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 31 00000100:00100000:0.0:1783135486.209794:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792294784:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783135486.210089:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783135486.210093:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783135485 -> 1783135484 00002000:00010000:0.0:1783135486.210095:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783135483 00002000:00010000:0.0:1783135486.210097:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783135485 -> 1783135484 00002000:00010000:0.0:1783135486.210100:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783135486.210162:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792294784:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 369us (541us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783135486.210171:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 31 00000100:00100000:0.0:1783135486.216125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135486.216203:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792295040 00000100:00100000:1.0:1783135486.216213:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792295040 00000100:00100000:1.0:1783135486.216273:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 82 00000100:00100000:1.0:1783135486.216283:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+13:10434:x1869752792295040:12345-192.168.201.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783135486.216354:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.216372:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.216398:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.216432:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.216460:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 13 pid: 5796 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135486.216475:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752813291264:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135486.216570:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38df00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135486.227720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.227759:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792295168 00000100:00100000:3.0:1783135486.227768:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792295168 00010000:00010000:3.0:1783135486.227810:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 14 pid: 5796 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.227876:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:3.0:1783135486.227887:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+14:2360:x1869752792295168:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135486.227904:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135486.227912:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 14 pid: 5796 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.227925:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 14 pid: 5796 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.227949:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:3.0:1783135486.227955:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.227965:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.227973:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.228010:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135486.228064:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+14:2360:x1869752792295168:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 177us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135486.228072:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 43 00010000:00010000:1.0:1783135486.228280:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875ce60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ecc expref: 13 pid: 5796 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135486.228296:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752813291264:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135486.228315:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228325:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228332:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228363:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228370:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228384:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228391:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135486.228394:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228402:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228410:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:1.0:1783135486.228413:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783135486.228417:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.228423:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875ce9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135486.228482:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+12:10434:x1869752792295040:12345-192.168.201.60@tcp:55:lhsmtool_posix.0 Request processed in 12200us (12364us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783135486.228490:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 82 00000100:00100000:0.0:1783135486.232293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.232359:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792295296 00000100:00100000:3.0:1783135486.232369:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792295296 00000100:00100000:3.0:1783135486.232423:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 32 00000100:00100000:3.0:1783135486.232434:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792295296:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783135486.232491:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.232512:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.232521:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135486.232525:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135486.232529:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.232565:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.232578:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 7 pid: 6590 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.232594:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813291392:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135486.232688:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135486.234725:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813291392:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135486.234755:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135486.235373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.235479:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792295424 00000100:00100000:3.0:1783135486.235487:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792295424 00010000:00010000:3.0:1783135486.235520:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 8 pid: 6590 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.235560:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:3.0:1783135486.235570:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+8:2361:x1869752792295424:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135486.235586:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135486.235609:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 8 pid: 6590 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235622:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 8 pid: 6590 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235647:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000562a9389/0xf646e0cda875ce91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ee8 expref: 8 pid: 6590 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235663:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135486.235667:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135486.235673:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235682:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235710:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135486.235781:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792295424:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 212us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135486.235791:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 44 00010000:00010000:3.0:1783135486.235897:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235907:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235932:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235941:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235951:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235958:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135486.235963:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235972:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.235984:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.236004:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875cea6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.236057:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792295296:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 Request processed in 3625us (3773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135486.236065:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 32 00000100:00100000:3.0:1783135486.240577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.240900:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792295680 00000100:00100000:0.0:1783135486.240911:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792295680 00000100:00100000:0.0:1783135486.240962:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 83 00000100:00100000:0.0:1783135486.240972:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+12:10434:x1869752792295680:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1783135486.241048:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.241067:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.241078:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.241332:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.241344:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 13 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.241352:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.241386:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 13 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.241400:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 13 pid: 9499 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135486.241416:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f1063f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813291520:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135486.241510:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135486.246998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.247030:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792295808 00000100:00100000:0.0:1783135486.247040:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792295808 00010000:00010000:0.0:1783135486.247082:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 14 pid: 9499 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135486.247118:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:0.0:1783135486.247127:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+14:2360:x1869752792295808:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135486.247141:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135486.247149:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 14 pid: 9499 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.247169:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 14 pid: 9499 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.247192:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:0.0:1783135486.247198:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.247209:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.247216:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.247234:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135486.247285:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+14:2360:x1869752792295808:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 158us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.247294:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 45 00010000:00010000:0.0:1783135486.247345:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875ce6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ed3 expref: 13 pid: 9499 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135486.247362:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f1063f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813291520:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135486.247381:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.247390:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.247396:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135486.247628:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1783135486.247785:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1783135486.247847:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1783135486.247921:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869752813291648:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783135486.247963:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.248001:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783135486.248704:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813291648 00000100:00100000:1.0:1783135486.248713:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813291648 00000100:00100000:1.0:1783135486.249102:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135486.249114:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1869752813291648:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1783135486.249223:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1869752813291648:12345-0@lo:1000:mdt00_001.0 Request processed in 110us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135486.249230:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135486.249954:0:5795:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1783135486.249963:0:5795:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f3c3c1f80, transno 4294967303 00000100:00100000:0.0:1783135486.249975:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869752813291648:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1783135486.252942:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1783135486.253045:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869752813291776:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783135486.253124:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135486.253165:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135486.254693:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813291776 00000100:00100000:3.0:1783135486.254707:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813291776 00000100:00100000:3.0:1783135486.254763:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135486.254773:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5795:x1869752813291776:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783135486.255069:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5795:x1869752813291776:12345-0@lo:1000:mdt00_001.0 Request processed in 296us (1944us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783135486.255077:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135486.255146:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5795:1869752813291776:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1783135486.255191:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255200:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255208:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255214:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135486.255219:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255238:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255255:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:3.0:1783135486.255258:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135486.255263:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255269:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875ceb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255307:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255313:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255318:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255322:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135486.255326:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255331:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255338:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:3.0:1783135486.255340:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135486.255343:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255358:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875cde9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255378:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255394:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255404:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255435:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.255464:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 16 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.255478:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db05500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813291904:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135486.255568:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05203e40 going to sleep for 11 seconds 00000100:00100000:3.0:1783135486.267265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135486.267301:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792295936 00000100:00100000:3.0:1783135486.267309:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792295936 00010000:00010000:3.0:1783135486.267347:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 17 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135486.267379:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:3.0:1783135486.267388:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+17:2360:x1869752792295936:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135486.267408:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135486.267415:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 17 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.267428:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 17 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.267462:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:3.0:1783135486.267468:0:11521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.267477:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.267485:0:11521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.267504:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135486.267556:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+17:2360:x1869752792295936:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 169us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135486.267564:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 46 00010000:00010000:2.0:1783135486.267654:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875ce05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eb7 expref: 16 pid: 5794 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135486.267671:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db05500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813291904:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135486.267694:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267704:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267710:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267722:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267729:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267736:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267742:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135486.267752:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267760:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267777:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:2.0:1783135486.267780:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135486.267784:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267790:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875cebb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267802:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267807:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267833:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267839:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135486.267842:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267848:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267855:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:2.0:1783135486.267857:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783135486.267860:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.267866:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875cead lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135486.268097:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+15:10434:x1869752792295680:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 27125us (27530us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1783135486.268106:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 83 00000020:00080000:2.0:1783135486.268110:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783135486.268365:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135486.268371:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135486.268400:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783135486.268406:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135486.277797:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135486.278016:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792296192 00000100:00100000:2.0:1783135486.278028:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792296192 00000100:00100000:2.0:1783135486.278116:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:2.0:1783135486.278125:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+15:10434:x1869752792296192:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1783135486.278859:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783135486.279017:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1783135486.279054:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.279069:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.279080:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.280106:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.280117:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.280123:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.280147:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135486.280213:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135486.280220:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.280227:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135486.280237:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.280245:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.280257:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8e8f18315400) 00000100:00100000:2.0:1783135486.280258:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+17:10434:x1869752792296192:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 2131us (2469us total) trans 4294967362 rc 0/0 00010000:00010000:3.0:1783135486.280260:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783135486.280264:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135486.280268:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 20 00010000:00010000:3.0:1783135486.280270:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cec2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1783135486.280274:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135486.280286:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135486.280288:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135486.280289:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783135486.590486:0:11855:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135486.590496:0:11855:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135486.590732:0:11855:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1783135486.590741:0:11855:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135486.840916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.840974:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792296448 00000100:00100000:0.0:1783135486.840989:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792296448 00000100:00100000:0.0:1783135486.841057:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00100000:0.0:1783135486.841069:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+17:10444:x1869752792296448:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135486.841099:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135486.841122:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875cec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11eef expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.841619:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875ced0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.841644:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875ced0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.841666:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875ced0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135486.841678:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1783135486.842294:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875cec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eef expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.842317:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875ced0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eef expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.842328:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:0.0:1783135486.842332:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135486.842336:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043a00, rc 0) 00000100:00100000:0.0:1783135486.842831:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+19:10444:x1869752792296448:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1745us (1907us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1783135486.842840:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00100000:0.0:1783135486.864453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135486.871874:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792296576 00000100:00100000:2.0:1783135486.871892:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792296576 00000100:00100000:2.0:1783135486.872028:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 85 00000100:00100000:2.0:1783135486.872039:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+19:10444:x1869752792296576:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:2.0:1783135486.872116:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873252:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873267:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873291:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873299:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873306:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873646:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873655:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873674:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135486.873720:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873881:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873890:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873897:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873903:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135486.873908:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873915:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873928:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:2.0:1783135486.873931:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135486.873936:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873943:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cede lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873955:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873966:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873972:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873977:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135486.873979:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873985:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.873991:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f18315800) 00010000:00010000:2.0:1783135486.873994:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135486.873996:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.874001:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cee5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.874015:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.874020:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.874025:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.874030:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135486.874038:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.874045:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.874052:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315300) 00010000:00010000:2.0:1783135486.874055:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135486.874057:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.874063:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875ceec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135486.875306:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+19:10444:x1869752792296576:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 3260us (10868us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.875319:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 85 00010000:00010000:2.0:1783135486.909920:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135486.938282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135486.938878:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792296832 00000100:00100000:2.0:1783135486.938887:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792296832 00000100:00100000:2.0:1783135486.938943:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 86 00000100:00100000:2.0:1783135486.938951:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+19:10447:x1869752792296832:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135486.938968:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135486.938989:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cef3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ef6 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939067:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939080:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939100:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939111:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939116:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939119:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939382:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939387:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939392:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135486.939398:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783135486.939502:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939509:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939926:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939935:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135486.939947:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939955:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939968:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:2.0:1783135486.939971:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135486.939975:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939981:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cefa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.939996:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.940001:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.940006:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.940011:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135486.940014:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.940018:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.940025:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f18315300) 00010000:00010000:2.0:1783135486.940028:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135486.940039:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.940045:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.940175:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cef3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 22 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.940193:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 21 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135486.940200:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:3.0:1783135486.940202:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135486.940204:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2a00, rc 0) 00000100:00100000:3.0:1783135486.940313:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+21:10447:x1869752792296832:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1361us (2048us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1783135486.940321:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 86 00000100:00100000:1.0:1783135486.945100:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.945209:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792296960 00000100:00100000:0.0:1783135486.945219:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792296960 00000100:00100000:0.0:1783135486.945350:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 87 00000100:00100000:0.0:1783135486.945361:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+21:10447:x1869752792296960:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:0.0:1783135486.945439:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945456:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945468:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945514:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945590:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945597:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945603:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135486.945608:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945616:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945629:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:0.0:1783135486.945631:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135486.945636:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135486.945643:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875cf16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135486.945772:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+21:10447:x1869752792296960:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 411us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.945779:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 87 00000100:00100000:1.0:1783135486.948516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.950941:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792297216 00000100:00100000:0.0:1783135486.950953:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792297216 00000100:00100000:0.0:1783135486.951271:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:0.0:1783135486.951355:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26326450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+21:10447:x1869752792297216:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135486.951653:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26326450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+22:10447:x1869752792297216:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 301us (3144us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1783135486.951660:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:1.0:1783135486.966939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135486.966978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135486.967021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135486.967061:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135486.967096:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792297728 00000100:00100000:1.0:1783135486.967106:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792297728 00000100:00100000:1.0:1783135486.967167:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 139 00000100:00100000:1.0:1783135486.967179:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2360:x1869752792297728:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135486.967265:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2360:x1869752792297728:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 87us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135486.967273:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 139 00000100:00080000:1.0:1783135486.967296:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135486.967473:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792297600 00000100:00100000:2.0:1783135486.967478:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792297600 00000100:00100000:2.0:1783135486.967523:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792297472 00000100:00100000:2.0:1783135486.967527:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792297472 00000100:00100000:2.0:1783135486.967547:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 76 00000100:00100000:2.0:1783135486.967554:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2360:x1869752792297600:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135486.967588:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2360:x1869752792297600:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 35us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.967595:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 76 00000100:00100000:2.0:1783135486.967609:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 77 00000100:00100000:2.0:1783135486.967615:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792297472:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135486.967640:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d665050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792297472:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 26us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135486.967646:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 77 00000100:00080000:1.0:1783135486.967852:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135486.968451:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792297344 00000100:00100000:0.0:1783135486.968457:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792297344 00000100:00100000:0.0:1783135486.968501:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 287 00000100:00100000:0.0:1783135486.968509:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2360:x1869752792297344:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135486.968559:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2360:x1869752792297344:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 50us (1631us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135486.968566:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 287 00000100:00100000:1.0:1783135486.981371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135486.981528:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792297984 00000100:00100000:2.0:1783135486.981540:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792297984 00000100:00100000:2.0:1783135486.981619:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 88 00000100:00100000:2.0:1783135486.981632:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+22:9975:x1869752792297984:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135486.981659:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135486.981681:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cf1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11efd expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.981986:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.982005:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.982015:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.982052:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.982066:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 23 pid: 9499 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135486.982082:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813292032:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135486.982227:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135486.990110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135486.990233:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813292032:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135486.990261:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135486.990342:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792298112 00000100:00100000:1.0:1783135486.990349:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792298112 00010000:00010000:1.0:1783135486.990387:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 24 pid: 9499 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135486.990453:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:1.0:1783135486.990464:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+24:2361:x1869752792298112:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135486.990495:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135486.990502:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 24 pid: 9499 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.990515:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 24 pid: 9499 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.990536:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ef6 expref: 24 pid: 9499 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.990553:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:1.0:1783135486.990557:0:6604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.990566:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.990572:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135486.990745:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135486.990805:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+23:2361:x1869752792298112:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 342us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135486.990860:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 47 00010000:00010000:2.0:1783135486.994000:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.994018:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135486.994046:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783135486.994216:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875cf1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.994259:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135486.994268:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:2.0:1783135486.994270:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783135486.994274:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2400, rc 0) 00000100:00100000:2.0:1783135486.994397:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+23:9975:x1869752792297984:12345-192.168.201.60@tcp:101:bash.0 Request processed in 12767us (13035us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1783135486.994407:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 88 00000100:00100000:2.0:1783135487.001940:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.002057:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792298368 00000100:00100000:1.0:1783135487.002068:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792298368 00000100:00100000:1.0:1783135487.002178:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 89 00000100:00100000:1.0:1783135487.002190:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+23:9975:x1869752792298368:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1783135487.002514:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.002544:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.002557:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135487.002615:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1783135487.002640:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad7588ef reply state 0000000050ae610b transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135487.002650:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783135487.002697:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1783135487.002811:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+27:9975:x1869752792298368:12345-192.168.201.60@tcp:36:bash.0 Request processed in 622us (880us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1783135487.002863:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 89 00000020:00080000:1.0:1783135487.002868:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1783135487.009190:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.009208:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.009216:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.009223:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135487.009228:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.009237:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.009255:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:2.0:1783135487.009260:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135487.009279:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.009287:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135487.011113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.011248:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792298496 00000100:00100000:1.0:1783135487.011258:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792298496 00000100:00100000:1.0:1783135487.011316:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 90 00000100:00100000:1.0:1783135487.011326:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+26:9975:x1869752792298496:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1783135487.011351:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135487.011369:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cf39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f04 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.011439:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cf39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f04 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.011472:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cf39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f04 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.011492:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:1.0:1783135487.011495:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135487.011498:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c600, rc 0) 00000100:00100000:1.0:1783135487.011565:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+27:9975:x1869752792298496:12345-192.168.201.60@tcp:101:bash.0 Request processed in 240us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135487.011573:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 90 00000100:00100000:0.0:1783135487.017433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135487.017536:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792298624 00000100:00100000:2.0:1783135487.017546:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792298624 00000100:00100000:2.0:1783135487.017627:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:2.0:1783135487.017637:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:9975:x1869752792298624:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135487.017656:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135487.017681:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f0b expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135487.017708:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a487cfc, atime: 0x6a487cfb, ctime: 0x6a487cfc, blocks: 0xb 00010000:00010000:2.0:1783135487.017915:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1783135487.017921:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135487.017932:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.017954:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.017968:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3200, rc 0) 00000100:00080000:1.0:1783135487.018112:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135487.018149:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:9975:x1869752792298624:12345-192.168.201.60@tcp:101:bash.0 Request processed in 513us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135487.018157:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:0.0:1783135487.027995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.028100:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792298752 00000100:00100000:1.0:1783135487.028110:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792298752 00002000:00010000:1.0:1783135487.028147:0:6593:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1783135487.028151:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3cf56d80 with x1869752792298752 ext(0->18446744073709551615) 00002000:00010000:1.0:1783135487.028163:0:6593:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3cf56d80. 00000100:00100000:1.0:1783135487.028194:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:1.0:1783135487.028203:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792298752:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:1.0:1783135487.028494:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1783135487.028499:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1783135484 -> 1783135486 00002000:00010000:1.0:1783135487.028501:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1783135483 -> 1783135483 00002000:00010000:1.0:1783135487.028503:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1783135484 -> 1783135486 00002000:00010000:1.0:1783135487.028505:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1783135487.028591:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792298752:12345-192.168.201.60@tcp:10:bash.0 Request processed in 387us (606us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783135487.028599:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1 00002000:00010000:1.0:1783135487.028616:0:6593:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:1.0:1783135487.028619:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3cf56d80 with x1869752792298752 ext(0->18446744073709551615) 00002000:00010000:1.0:1783135487.028624:0:6593:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3cf56d80. 00000100:00100000:2.0:1783135487.145573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135487.145683:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792298880 00000100:00100000:3.0:1783135487.145718:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792298880 00000100:00100000:3.0:1783135487.145784:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 91 00000100:00100000:3.0:1783135487.145795:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+27:10461:x1869752792298880:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:2.0:1783135487.146131:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146149:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146161:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146175:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146181:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146186:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146470:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146479:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146485:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135487.146521:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146532:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146549:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146556:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146563:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135487.146567:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146575:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146587:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:2.0:1783135487.146590:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135487.146594:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146599:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cf47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146614:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146618:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146623:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146628:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135487.146637:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146644:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146651:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f18315100) 00010000:00010000:2.0:1783135487.146653:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135487.146656:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146661:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cf4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146675:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146681:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146686:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146691:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135487.146693:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146699:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146706:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:2.0:1783135487.146708:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135487.146717:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.146724:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cf55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135487.146915:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+27:10461:x1869752792298880:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 1023us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135487.146925:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 91 00000100:00100000:2.0:1783135487.197959:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.198136:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792299136 00000100:00100000:1.0:1783135487.198146:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792299136 00000100:00100000:1.0:1783135487.198208:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 92 00000100:00100000:1.0:1783135487.198217:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+27:10464:x1869752792299136:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135487.198237:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135487.198256:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f12 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198323:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198338:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198349:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198362:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198369:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198376:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198683:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cf71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198698:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cf71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198706:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cf71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135487.198717:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783135487.198877:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198885:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198893:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198899:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.198903:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198910:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198924:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135487.198927:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.198932:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198938:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.198951:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199125:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199132:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199137:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.199140:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199147:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199155:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f10923600) 00010000:00010000:1.0:1783135487.199158:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.199161:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199168:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199206:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f12 expref: 30 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199218:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cf71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f12 expref: 29 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.199225:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:1.0:1783135487.199228:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783135487.199236:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d800, rc 0) 00000100:00100000:1.0:1783135487.199304:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+29:10464:x1869752792299136:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1087us (1355us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1783135487.199312:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 92 00000100:00100000:0.0:1783135487.207234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.207332:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792299264 00000100:00100000:1.0:1783135487.207342:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792299264 00000100:00100000:1.0:1783135487.207406:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 93 00000100:00100000:1.0:1783135487.207416:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+29:10464:x1869752792299264:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:1.0:1783135487.207536:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.207554:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.207563:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.207594:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.207607:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 29 pid: 5794 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135487.207621:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813292160:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135487.207707:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38d480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135487.210144:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813292160:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135487.210173:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135487.214773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135487.214871:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792299520 00000100:00100000:2.0:1783135487.214881:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792299520 00000100:00100000:2.0:1783135487.214939:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:2.0:1783135487.214951:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+30:5576:x1869752792299520:12345-192.168.201.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783135487.215246:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+31:5576:x1869752792299520:12345-192.168.201.60@tcp:35:ldlm_bl.0 Request processed in 297us (484us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1783135487.215252:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:3.0:1783135487.217305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135487.217409:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792299648 00000100:00100000:0.0:1783135487.217430:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792299648 00010000:00010000:0.0:1783135487.217477:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 31 pid: 5794 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135487.217521:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:0.0:1783135487.217530:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+31:2360:x1869752792299648:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135487.217560:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135487.217569:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 31 pid: 5794 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.217581:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 31 pid: 5794 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.217603:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cf24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11efd expref: 31 pid: 5794 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.217621:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:0.0:1783135487.217626:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.217636:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.217643:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.217673:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135487.217739:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+30:2360:x1869752792299648:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 209us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135487.217745:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 48 00010000:00010000:1.0:1783135487.218257:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.218267:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.218297:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.218304:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.218311:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.218317:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121dc00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.218322:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.218329:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.218339:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:1.0:1783135487.218342:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135487.218346:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.218351:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135487.218403:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+29:10464:x1869752792299264:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 10988us (11179us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135487.218431:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 93 00000100:00100000:3.0:1783135487.223958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135487.224184:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792299904 00000100:00100000:2.0:1783135487.224195:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792299904 00000100:00100000:2.0:1783135487.224251:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:2.0:1783135487.224260:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+29:10464:x1869752792299904:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:2.0:1783135487.224525:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+30:10464:x1869752792299904:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 264us (573us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1783135487.224532:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 23 00000040:00080000:3.0:1783135487.291586:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135487.291597:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135487.291632:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783135487.291639:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135487.346593:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.350856:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792300160 00000100:00100000:1.0:1783135487.350871:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792300160 00000100:00100000:1.0:1783135487.351896:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 94 00000100:00100000:1.0:1783135487.351912:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+30:10475:x1869752792300160:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:1.0:1783135487.351942:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135487.352129:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f19 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352219:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352234:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352246:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352260:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352267:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352273:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352629:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352651:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.352658:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135487.352671:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1783135487.353165:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353175:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353182:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353188:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.353193:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353199:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353212:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135487.353215:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.353219:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353225:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cf8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353240:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353253:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353259:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353264:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.353267:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353273:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353280:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f10923600) 00010000:00010000:1.0:1783135487.353283:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.353285:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353290:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cf94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353337:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875cf86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f19 expref: 33 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353350:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f19 expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.353358:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:1.0:1783135487.353360:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135487.353368:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c200, rc 0) 00000100:00100000:1.0:1783135487.353527:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+32:10475:x1869752792300160:12345-192.168.201.60@tcp:101:cat.0 Request processed in 1619us (6945us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1783135487.353537:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 94 00000100:00100000:3.0:1783135487.361348:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135487.364101:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792300416 00000100:00100000:2.0:1783135487.364121:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792300416 00000100:00100000:2.0:1783135487.364207:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:2.0:1783135487.364216:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+32:10475:x1869752792300416:12345-192.168.201.60@tcp:35:cat.0 00000100:00100000:2.0:1783135487.364493:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+33:10475:x1869752792300416:12345-192.168.201.60@tcp:35:cat.0 Request processed in 277us (3152us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1783135487.364501:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:3.0:1783135487.391525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135487.391952:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792300672 00000100:00100000:2.0:1783135487.391963:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792300672 00000100:00100000:2.0:1783135487.392080:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 95 00000100:00100000:2.0:1783135487.392091:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+33:10476:x1869752792300672:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1783135487.392152:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783135487.392179:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875cf9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f19 expref: 33 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392204:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875cf71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f12 expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392216:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875cf39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f04 expref: 31 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392227:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315800) 00010000:00010000:2.0:1783135487.392237:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135487.392260:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392274:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392283:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392316:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392324:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392330:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392648:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392657:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.392664:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135487.393333:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1783135487.393344:0:9499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386822528136ns, next at 387822525303ns, rc = 0 00010000:00010000:2.0:1783135487.393404:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393415:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393437:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393445:0:9499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393463:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393469:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393492:0:9499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135487.393512:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393518:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393524:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393529:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135487.393533:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393540:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393550:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315c00) 00010000:00010000:2.0:1783135487.393553:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783135487.393557:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393563:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfb7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393578:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393591:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393596:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393614:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135487.393617:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393623:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393632:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:2.0:1783135487.393634:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135487.393638:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.393643:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfa9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135487.393654:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005d7dfe96 reply state 00000000f6697478 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135487.393662:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135487.393740:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+32:10476:x1869752792300672:12345-192.168.201.60@tcp:36:rm.0 Request processed in 1648us (2223us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1783135487.393748:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 95 00010000:00010000:3.0:1783135487.393854:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135487.393862:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.393868:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135487.393872:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.393878:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.393886:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8e8f18315c00) 00010000:00010000:3.0:1783135487.393889:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783135487.393891:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.393896:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875cfbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.393921:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135487.393923:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135487.393925:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135487.396250:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.396269:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.396296:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.396303:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135487.396308:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.396316:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.396330:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f18315100) 00010000:00010000:0.0:1783135487.396332:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135487.396337:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.396343:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135487.449254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135487.449467:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792300928 00000100:00100000:2.0:1783135487.449478:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792300928 00000100:00100000:2.0:1783135487.449563:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 96 00000100:00100000:2.0:1783135487.449584:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+31:10482:x1869752792300928:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135487.449609:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135487.449632:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfc5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f20 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.449760:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.449776:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.449788:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.449802:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.449809:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.449833:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783135487.450413:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1783135487.450608:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450620:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450628:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450675:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450683:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450690:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450697:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135487.450702:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450709:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450723:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:2.0:1783135487.450727:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135487.450732:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450738:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875cfcc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135487.450753:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000814bf3d reply state 00000000e4e5934a transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135487.450762:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783135487.450792:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875cfc5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450870:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 33 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.450879:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f18315100) 00010000:00010000:2.0:1783135487.450882:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135487.450884:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2a00, rc 0) 00000100:00100000:2.0:1783135487.450964:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+34:10482:x1869752792300928:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1393us (1722us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783135487.450972:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 96 00010000:00010000:2.0:1783135487.453648:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.453667:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.453674:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.453681:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135487.453686:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.453696:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.453716:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f18315800) 00010000:00010000:2.0:1783135487.453788:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135487.453795:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.453842:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875cfd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135487.460095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.460196:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792301056 00000100:00100000:1.0:1783135487.460205:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792301056 00000100:00100000:1.0:1783135487.460267:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 34 00000100:00100000:1.0:1783135487.460277:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792301056:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1783135487.460295:0:8303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135487.460316:0:8303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f27 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135487.460346:0:8303:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783135487.460364:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:1.0:1783135487.460368:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135487.460378:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 6 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.460401:0:8303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 6 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.460426:0:8303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121dc00, rc 0) 00000100:00100000:1.0:1783135487.460494:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792301056:12345-192.168.201.60@tcp:101:bash.0 Request processed in 217us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135487.460500:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 34 00000100:00100000:3.0:1783135487.467675:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135487.467849:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792301184 00000100:00100000:0.0:1783135487.467863:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792301184 00000100:00100000:0.0:1783135487.467930:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 35 00000100:00100000:0.0:1783135487.467939:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+6:10482:x1869752792301184:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135487.467957:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135487.467974:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f2e expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.468006:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 7 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.468034:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135487.468038:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135487.468044:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.468077:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 7 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.468089:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 7 pid: 8303 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135487.468103:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cf57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6587:1869752813292288:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135487.468214:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135487.481479:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cf57100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6587:1869752813292288:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135487.481523:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 7 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.481541:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042c00, rc 0) 00000100:00100000:0.0:1783135487.481591:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:10482:x1869752792301184:12345-192.168.201.60@tcp:101:bash.0 Request processed in 13654us (13926us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135487.481599:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 35 00000100:00100000:2.0:1783135487.481709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135487.481812:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792301312 00000100:00100000:0.0:1783135487.481837:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792301312 00010000:00010000:0.0:1783135487.481868:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 7 pid: 8303 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135487.481928:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:0.0:1783135487.481939:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792301312:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135487.481955:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135487.481980:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 7 pid: 8303 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.481993:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 7 pid: 8303 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.482017:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000059e968f/0xf646e0cda875cfe8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f27 expref: 7 pid: 8303 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.482032:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135487.482036:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135487.482044:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 6 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.482054:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 6 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.482088:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 6 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135487.482102:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cf57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1869752813292416:192.168.201.60@tcp:105: 00000100:00100000:0.0:1783135487.482160:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05205480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135487.490733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135487.490883:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cf57100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1869752813292416:192.168.201.60@tcp:105: 00010000:00010000:0.0:1783135487.490918:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135487.491029:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c8a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792301312:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 9090us (9319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135487.491071:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:2.0:1783135487.492521:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792301568 00000100:00100000:2.0:1783135487.492534:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792301568 00000100:00100000:2.0:1783135487.492602:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:2.0:1783135487.492613:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+33:10482:x1869752792301568:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1783135487.494121:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+34:10482:x1869752792301568:12345-192.168.201.60@tcp:35:bash.0 Request processed in 1503us (3389us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1783135487.494133:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:3.0:1783135487.610015:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135487.610039:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813292544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135487.610111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135487.610336:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813292544 00000100:00100000:0.0:1783135487.610344:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813292544 00000100:00100000:0.0:1783135487.610422:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783135487.610432:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813292544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135487.610469:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135487.610535:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813292544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135487.610543:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1783135487.610601:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813292544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135487.708913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.710654:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792301696 00000100:00100000:1.0:1783135487.710668:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792301696 00000100:00100000:1.0:1783135487.710746:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 97 00000100:00100000:1.0:1783135487.710756:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+34:10498:x1869752792301696:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135487.710779:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135487.710798:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cff6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f35 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.710876:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cffd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.710891:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.710902:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135487.710958:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783135487.710961:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135487.710979:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cffd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.711001:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875cff6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f35 expref: 36 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.711018:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cffd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f35 expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.711046:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135487.711049:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135487.711052:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d000, rc 0) 00000100:00100000:1.0:1783135487.711113:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+35:10498:x1869752792301696:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 358us (2210us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135487.711121:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 97 00000100:00100000:3.0:1783135487.721751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135487.721976:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792301952 00000100:00100000:2.0:1783135487.721986:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792301952 00000100:00100000:2.0:1783135487.722049:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 98 00000100:00100000:2.0:1783135487.722059:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+35:10498:x1869752792301952:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135487.722081:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135487.722102:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d004 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f3c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.722207:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d00b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.722360:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d00b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.722373:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d00b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135487.722405:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783135487.722555:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d004 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f3c expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.722576:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d00b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f3c expref: 37 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.722585:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f18315100) 00010000:00010000:2.0:1783135487.722587:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135487.722591:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2400, rc 0) 00000100:00100000:2.0:1783135487.722660:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+37:10498:x1869752792301952:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 601us (925us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783135487.722667:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 98 00000100:00100000:3.0:1783135487.729078:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.729237:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792302208 00000100:00100000:1.0:1783135487.729247:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792302208 00000100:00100000:1.0:1783135487.729312:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 99 00000100:00100000:1.0:1783135487.729324:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+37:10498:x1869752792302208:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135487.729350:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135487.729372:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875d019 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f43 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.729481:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d020 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.729496:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.729516:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d020 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135487.729528:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783135487.729651:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875d019 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f43 expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.729702:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d020 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f43 expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.729711:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f18315100) 00010000:00010000:1.0:1783135487.729714:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783135487.729717:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121da00, rc 0) 00000100:00100000:1.0:1783135487.729790:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+39:10498:x1869752792302208:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 469us (724us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1783135487.729797:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 99 00000100:00100000:3.0:1783135487.736349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135487.736445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135487.737257:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792302464 00000100:00100000:0.0:1783135487.737268:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792302464 00000100:00100000:0.0:1783135487.737337:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:0.0:1783135487.737347:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+39:2362:x1869752792302464:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135487.737362:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135487.737389:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d00b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f3c expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.737422:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f18315100) 00010000:00010000:0.0:1783135487.737427:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135487.737493:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+38:2362:x1869752792302464:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 147us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135487.737501:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:1.0:1783135487.741608:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792302336 00000100:00100000:1.0:1783135487.741623:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792302336 00000100:00100000:1.0:1783135487.741771:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 36 00000100:00100000:1.0:1783135487.741782:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792302336:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1783135487.741854:0:8303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.741874:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 6 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.741883:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1783135487.741887:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135487.741891:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.741925:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 6 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.741951:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 6 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135487.741965:0:8303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8303:1869752813292672:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135487.742054:0:8303:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3c38df00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135487.750087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135487.750544:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792302592 00000100:00100000:3.0:1783135487.750553:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792302592 00002000:00100000:3.0:1783135487.750600:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e8f3c3c0380 x1869752792302592/t0(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:658/0 lens 504/0 e 0 to 0 dl 1783135498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135487.750611:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3c3c0380 with x1869752792302592 ext(0->8) 00010000:00010000:3.0:1783135487.750620:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 7 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.750637:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 7 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135487.750664:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8f3c3c0380 00000100:00100000:3.0:1783135487.750702:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:3.0:1783135487.750720:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792302592:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:3.0:1783135487.751543:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c7819a6-778a-4617-af33-00460db74182+9:2361:x1869752792302592:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 827us (1465us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1783135487.751552:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1 00002000:00100000:3.0:1783135487.751560:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8e8f3c3c0380 x1869752792302592/t4294967302(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:658/0 lens 504/448 e 0 to 0 dl 1783135498 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135487.751570:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3c3c0380 with x1869752792302592 ext(0->8) 00010000:00010000:3.0:1783135487.751577:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 9 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.751591:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 9 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135487.751598:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8f3c3c0380 00000100:00100000:1.0:1783135487.752289:0:8303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8303:1869752813292672:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135487.752314:0:8303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135487.756195:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135487.756438:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792302720 00000100:00100000:3.0:1783135487.756449:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792302720 00010000:00010000:3.0:1783135487.756493:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 9 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135487.756987:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 50 00000100:00100000:3.0:1783135487.757000:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792302720:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135487.757032:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1783135487.757053:0:11521:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1783135487.757057:0:11521:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783135487 00002000:00010000:3.0:1783135487.757059:0:11521:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783135487 00002000:00010000:3.0:1783135487.757061:0:11521:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783135487 00010000:00010000:3.0:1783135487.757068:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 9 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.757082:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 9 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.757106:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c90cca4/0xf646e0cda875cfef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f2e expref: 9 pid: 6587 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.757124:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135487.757128:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135487.757134:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.757145:0:11521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.757178:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135487.758726:0:8303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.758773:0:8303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.758852:0:8303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.758862:0:8303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.758870:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.758878:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135487.758882:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.758892:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.758912:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.758920:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d02e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135487.766119:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792302720:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 9109us (9921us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135487.766134:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 50 00000100:00100000:0.0:1783135487.766618:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792302336:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 24836us (30277us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135487.766629:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 36 00000100:00100000:3.0:1783135487.771792:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135487.772037:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792302976 00000100:00100000:0.0:1783135487.772049:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792302976 00000100:00100000:0.0:1783135487.772112:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 26 00000100:00100000:0.0:1783135487.772123:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26325050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+38:10498:x1869752792302976:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:0.0:1783135487.772190:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d020 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f43 expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135487.772460:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1783135487.772507:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1783135487.772876:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1783135487.772931:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.772947:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.772956:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.772991:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 42 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135487.773004:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 42 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135487.773041:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cf56300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1869752813292800:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135487.773125:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9a840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135487.776948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135487.777082:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cf56300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1869752813292800:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135487.777110:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135487.779654:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792303104 00000100:00100000:1.0:1783135487.779671:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792303104 00010000:00010000:1.0:1783135487.779812:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 43 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135487.781241:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 51 00000100:00100000:2.0:1783135487.781266:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+43:2361:x1869752792303104:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135487.781286:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135487.781296:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 43 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.781311:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 43 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.781333:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875cfda lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f20 expref: 43 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.781368:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f18315100) 00010000:00010000:2.0:1783135487.781374:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.781383:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.781391:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135487.781439:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135487.781507:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+42:2361:x1869752792303104:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 253us (4568us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135487.781515:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 51 00010000:00010000:3.0:1783135487.781601:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135487.781609:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135487.782476:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1783135487.782725:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1783135487.783107:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d13ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813292928:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135487.783171:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135487.783199:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08911240 going to sleep for 11 seconds 00000100:00100000:3.0:1783135487.783242:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813292928 00000100:00100000:3.0:1783135487.783249:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813292928 00000100:00100000:3.0:1783135487.783294:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135487.783302:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5797:x1869752813292928:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135487.783365:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5797:x1869752813292928:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 63us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135487.783371:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135487.783421:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d13ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813292928:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1783135487.783626:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1783135487.785367:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1783135487.785664:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d13ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813293056:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135487.785899:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135487.785927:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f180bf180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135487.786073:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813293056 00000100:00100000:0.0:1783135487.786080:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813293056 00000100:00100000:0.0:1783135487.789060:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135487.789087:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5797:x1869752813293056:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783135487.789385:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5797:x1869752813293056:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 310us (3485us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1783135487.789395:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135487.789548:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d13ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813293056:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1783135487.789628:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1783135487.789679:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.789691:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.789699:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.789721:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.789726:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.789734:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.789751:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f18315100) 00010000:00010000:1.0:1783135487.789754:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783135487.789759:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.789766:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d035 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783135487.789974:0:5797:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783135487.790065:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1783135487.790076:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387219259930ns, next at 388219257604ns, rc = 0 00000001:00080000:1.0:1783135487.790082:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1783135487.790116:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f18315100) 00010000:00010000:1.0:1783135487.790118:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783135487.790125:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d020 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f43 expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135487.790222:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26325050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+45:10498:x1869752792302976:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 18101us (18441us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1783135487.790234:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 26 00000020:00080000:1.0:1783135487.790238:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783135487.793904:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.794060:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792303232 00000100:00100000:1.0:1783135487.794069:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792303232 00000100:00100000:1.0:1783135487.794125:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 100 00000100:00100000:1.0:1783135487.794134:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+45:10498:x1869752792303232:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135487.794158:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135487.794181:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d03c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f4a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.794254:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d03c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f4a expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.794267:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d03c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f4a expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.794285:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135487.794288:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135487.794292:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c000, rc 0) 00000100:00100000:1.0:1783135487.794343:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+46:10498:x1869752792303232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 209us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135487.794349:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 100 00000100:00100000:3.0:1783135487.804365:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.804573:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792303488 00000100:00100000:1.0:1783135487.804583:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792303488 00000100:00100000:1.0:1783135487.804654:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 27 00000100:00100000:1.0:1783135487.804665:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+46:10498:x1869752792303488:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1783135487.805182:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+47:10498:x1869752792303488:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 517us (825us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1783135487.805190:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 27 00000100:00100000:3.0:1783135487.923797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.923979:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792303616 00000100:00100000:1.0:1783135487.923989:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792303616 00000100:00100000:1.0:1783135487.924052:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 101 00000100:00100000:1.0:1783135487.924062:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+47:10508:x1869752792303616:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:1.0:1783135487.924130:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924147:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924158:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924172:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924178:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924184:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924286:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924296:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924302:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135487.924345:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924373:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924380:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924386:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924392:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121da00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.924396:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924403:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924429:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135487.924431:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.924436:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924442:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d043 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924458:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924464:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924469:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924480:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.924483:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924489:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924497:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f10923e00) 00010000:00010000:1.0:1783135487.924499:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.924512:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924517:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d04a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924533:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924539:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924544:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924549:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.924552:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924557:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924576:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135487.924578:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.924581:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.924586:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d051 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135487.924666:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+47:10508:x1869752792303616:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 604us (877us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135487.924674:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 101 00010000:00010000:3.0:1783135487.930461:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135487.995576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135487.995688:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792303872 00000100:00100000:1.0:1783135487.995699:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792303872 00000100:00100000:1.0:1783135487.995759:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 102 00000100:00100000:1.0:1783135487.995770:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+47:10511:x1869752792303872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135487.995789:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135487.995810:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d058 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f51 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.995935:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.995951:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.995960:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.995972:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.995985:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.995991:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996136:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d06d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996144:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d06d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996151:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d06d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135487.996160:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1783135487.996268:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996275:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996282:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996288:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.996292:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996300:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996325:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135487.996328:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.996333:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996339:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d05f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996354:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996360:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996366:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996370:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121da00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135487.996373:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996379:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996385:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f10923e00) 00010000:00010000:1.0:1783135487.996387:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135487.996404:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996418:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d066 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996469:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d058 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f51 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996483:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d06d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f51 expref: 49 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135487.996490:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135487.996492:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135487.996495:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c800, rc 0) 00000100:00100000:1.0:1783135487.996568:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+49:10511:x1869752792303872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 800us (1003us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1783135487.996576:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 102 00000100:00100000:3.0:1783135488.005350:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135488.013640:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792304000 00000100:00100000:1.0:1783135488.013667:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792304000 00000100:00080000:2.0:1783135488.013983:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135488.014083:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 103 00000100:00100000:1.0:1783135488.014104:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+49:10511:x1869752792304000:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:1.0:1783135488.014211:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014241:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014258:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014302:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014336:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014345:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014639:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135488.014644:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014654:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014670:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135488.014674:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135488.014678:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.014684:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d07b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135488.016118:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+49:10511:x1869752792304000:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 2010us (10772us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135488.016135:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 103 00000100:00100000:3.0:1783135488.025492:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135488.025669:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792304256 00000100:00100000:1.0:1783135488.025680:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792304256 00000100:00100000:1.0:1783135488.025748:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:1.0:1783135488.025758:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+49:10511:x1869752792304256:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135488.026091:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+50:10511:x1869752792304256:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 333us (608us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1783135488.026101:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:2.0:1783135488.124472:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813293184:0@lo:400:kworker.0 00000100:00100000:2.0:1783135488.124557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135488.124681:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813293184 00000100:00100000:1.0:1783135488.124701:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813293184 00000100:00100000:1.0:1783135488.124747:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1783135488.124757:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3313:x1869752813293184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135488.129869:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813293312:0@lo:400:kworker.0 00000100:00100000:2.0:1783135488.129966:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135488.130035:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813293312 00000100:00100000:2.0:1783135488.130043:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813293312 00000100:00100000:2.0:1783135488.130100:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783135488.130107:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813293312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135488.130155:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813293312:12345-0@lo:400:kworker.0 Request processed in 48us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135488.130177:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1783135488.130213:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813293312:0@lo:400:kworker.0 00000100:00100000:1.0:1783135488.130417:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10ad2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3313:x1869752813293184:12345-0@lo:400:kworker.0 Request processed in 5660us (5858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135488.130426:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1783135488.130750:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813293568:0@lo:400:kworker.0 00000100:00100000:3.0:1783135488.130783:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135488.130802:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135488.130807:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813293440:0@lo:400:kworker.0 00000100:00100000:3.0:1783135488.130842:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135488.130863:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813293568 00000100:00100000:3.0:1783135488.130867:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813293568 00000100:00100000:3.0:1783135488.130897:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813293440 00000100:00100000:3.0:1783135488.130899:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813293440 00000100:00100000:3.0:1783135488.130915:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783135488.130921:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813293568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135488.130952:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813293568:12345-0@lo:400:kworker.0 Request processed in 32us (168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135488.130958:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783135488.130969:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783135488.130974:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813293440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135488.130992:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869752813293440:12345-0@lo:400:kworker.0 Request processed in 18us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135488.130997:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1783135488.131009:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135488.131025:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3312:1869752813293440:0@lo:400:kworker.0 00000100:00100000:3.0:1783135488.131056:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813293568:0@lo:400:kworker.0 00000100:00100000:0.0:1783135488.135137:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813293184:0@lo:400:kworker.0 00000100:00100000:2.0:1783135488.157001:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135488.159399:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792304512 00000100:00100000:3.0:1783135488.159423:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792304512 00000100:00100000:3.0:1783135488.159501:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 104 00000100:00100000:3.0:1783135488.159511:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+50:10521:x1869752792304512:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1783135488.159541:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135488.159544:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135488.159573:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875cffd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f35 expref: 50 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.159594:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:3.0:1783135488.159599:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135488.159613:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d082 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f58 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.159714:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486600/0xf646e0cda875d089 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.159727:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486600/0xf646e0cda875d089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.159737:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486600/0xf646e0cda875d089 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135488.159748:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783135488.159946:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d082 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f58 expref: 52 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.159961:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486600/0xf646e0cda875d089 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f58 expref: 51 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.159983:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:3.0:1783135488.159986:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135488.159989:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486600, rc 0) 00000100:00100000:3.0:1783135488.160067:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+51:10521:x1869752792304512:12345-192.168.201.60@tcp:101:bash.0 Request processed in 557us (3079us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1783135488.160075:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 104 00000100:00100000:3.0:1783135488.166874:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135488.174926:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792304768 00000100:00100000:2.0:1783135488.174955:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792304768 00000100:00100000:1.0:1783135488.175113:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 105 00000100:00100000:1.0:1783135488.175126:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+51:10521:x1869752792304768:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1783135488.175192:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1783135488.175232:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486600/0xf646e0cda875d089 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f58 expref: 51 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.175257:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d06d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f51 expref: 50 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.175269:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135488.175273:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135488.175509:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.175529:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.175540:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135488.175594:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1783135488.175621:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000017043ace reply state 0000000041883736 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135488.175650:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135488.175767:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+52:10521:x1869752792304768:12345-192.168.201.60@tcp:36:bash.0 Request processed in 643us (8902us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1783135488.175773:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 105 00000020:00080000:1.0:1783135488.175778:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135488.179025:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.179042:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.179159:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.179166:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135488.179171:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.179178:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.179194:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:3.0:1783135488.179198:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135488.179202:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.179208:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d097 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135488.181729:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135488.182055:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792304896 00000100:00100000:2.0:1783135488.182065:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792304896 00000100:00100000:2.0:1783135488.182128:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 106 00000100:00100000:2.0:1783135488.182138:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+51:10521:x1869752792304896:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135488.182169:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135488.182196:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d09e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f5f expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.182294:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.182309:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.182321:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135488.182351:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783135488.182355:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135488.182376:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.182425:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d09e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 53 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.182461:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 52 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.182469:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:2.0:1783135488.182472:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135488.182476:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2a00, rc 0) 00000100:00100000:2.0:1783135488.182987:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+52:10521:x1869752792304896:12345-192.168.201.60@tcp:101:bash.0 Request processed in 846us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135488.182996:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 106 00000100:00100000:0.0:1783135488.185911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135488.186001:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792305152 00000100:00100000:2.0:1783135488.186011:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792305152 00000100:00100000:2.0:1783135488.186100:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:2.0:1783135488.186112:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+52:10521:x1869752792305152:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1783135488.186333:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+53:10521:x1869752792305152:12345-192.168.201.60@tcp:35:bash.0 Request processed in 223us (429us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1783135488.186339:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:0.0:1783135488.293092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135488.293195:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792305280 00000100:00100000:3.0:1783135488.293206:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792305280 00000100:00100000:3.0:1783135488.293274:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 107 00000100:00100000:3.0:1783135488.293287:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+53:10527:x1869752792305280:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135488.293311:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135488.293332:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d0ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f66 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.293397:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d0b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.293422:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.293433:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135488.293635:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1783135488.293641:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135488.293670:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d0b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.293697:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d0ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f66 expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.293725:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d0b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f66 expref: 54 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135488.293747:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:3.0:1783135488.293750:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135488.293754:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487a00, rc 0) 00000100:00100000:3.0:1783135488.293994:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+54:10527:x1869752792305280:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 708us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135488.294003:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 107 00000100:00100000:3.0:1783135488.297348:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135488.297458:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792305408 00000100:00100000:2.0:1783135488.297470:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792305408 00000100:00100000:2.0:1783135488.297549:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 108 00000100:00100000:2.0:1783135488.297559:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+54:10527:x1869752792305408:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135488.297579:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135488.297600:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f6d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.297669:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.297698:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.297723:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.297738:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.297744:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.297750:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298044:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298054:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298061:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135488.298100:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783135488.298104:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135488.298121:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298132:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298153:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298159:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298165:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298171:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135488.298175:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298182:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298193:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:2.0:1783135488.298196:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135488.298201:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298207:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298220:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298227:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298232:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298246:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135488.298249:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298255:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298263:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f18315800) 00010000:00010000:2.0:1783135488.298265:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135488.298268:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298274:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298304:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298317:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.298324:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:2.0:1783135488.298327:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135488.298329:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3e00, rc 0) 00000100:00100000:2.0:1783135488.298385:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+55:10527:x1869752792305408:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 827us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135488.298394:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 108 00000100:00100000:0.0:1783135488.302791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135488.302977:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792305664 00000100:00100000:1.0:1783135488.302989:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792305664 00000100:00100000:1.0:1783135488.303043:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 109 00000100:00100000:1.0:1783135488.303054:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+55:10527:x1869752792305664:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135488.303076:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135488.303097:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d0d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f74 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.303203:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.303218:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 56 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.303228:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.303236:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.303272:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.303308:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 56 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135488.303323:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813293696:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135488.303429:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 56 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.303438:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 56 pid: 9499 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135488.303447:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813293824:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135488.303471:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f055cb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135488.305997:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813293696:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135488.306013:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813293824:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135488.306040:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135488.307747:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135488.307782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135488.307884:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792305792 00000100:00100000:1.0:1783135488.307893:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792305792 00010000:00010000:1.0:1783135488.307931:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 57 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135488.307972:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792305920 00000100:00100000:1.0:1783135488.307975:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792305920 00010000:00010000:1.0:1783135488.307987:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 58 pid: 9499 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135488.308035:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 52 00000100:00100000:1.0:1783135488.308045:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+58:2361:x1869752792305792:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135488.308058:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135488.308065:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 58 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308077:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 58 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308098:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d0cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f6d expref: 58 pid: 5794 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308114:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135488.308119:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308128:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308134:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135488.308184:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf56a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+57:2361:x1869752792305792:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 139us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135488.308192:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 52 00000100:00100000:1.0:1783135488.308210:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 53 00000100:00100000:1.0:1783135488.308217:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+56:2360:x1869752792305920:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135488.308233:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135488.308238:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 56 pid: 9499 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308247:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 56 pid: 9499 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308259:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d0a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f5f expref: 56 pid: 9499 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308270:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135488.308273:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308280:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308287:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308310:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135488.308329:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+55:2360:x1869752792305920:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 113us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135488.308335:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 53 00010000:00010000:1.0:1783135488.308357:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308363:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135488.308391:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783135488.308551:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d0d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 56 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308568:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 55 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135488.308575:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135488.308577:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135488.308580:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121da00, rc 0) 00000100:00100000:1.0:1783135488.308611:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+55:10527:x1869752792305664:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 5559us (5831us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1783135488.308619:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 109 00000100:00100000:0.0:1783135488.312585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135488.312689:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792306176 00000100:00100000:2.0:1783135488.312722:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792306176 00000100:00100000:2.0:1783135488.312786:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:2.0:1783135488.312796:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+55:10527:x1869752792306176:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1783135488.312852:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135488.312877:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d03c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f4a expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.312897:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:2.0:1783135488.312902:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135488.312950:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf54700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+54:10527:x1869752792306176:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 155us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135488.312958:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:3.0:1783135488.316926:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135488.317022:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792306304 00000100:00100000:2.0:1783135488.317033:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792306304 00000100:00100000:2.0:1783135488.317101:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 110 00000100:00100000:2.0:1783135488.317111:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+54:10527:x1869752792306304:12345-192.168.201.60@tcp:58:lfs.0 00010000:00010000:2.0:1783135488.317222:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.317240:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.317252:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135488.317470:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1783135488.317543:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+54:10527:x1869752792306304:12345-192.168.201.60@tcp:58:lfs.0 Request processed in 433us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135488.317551:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 110 00000100:00100000:0.0:1783135488.322791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135488.322898:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792306432 00000100:00100000:2.0:1783135488.322908:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792306432 00000100:00100000:2.0:1783135488.322967:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 111 00000100:00100000:2.0:1783135488.322977:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+54:10527:x1869752792306432:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135488.323001:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135488.323022:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f7b expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.323089:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.323101:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f7b expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.323120:0:5795:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.323132:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f7b expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.323145:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:2.0:1783135488.323148:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135488.323152:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f7b expref: 55 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135488.323160:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2400, rc 0) 00000100:00100000:2.0:1783135488.323223:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+55:10527:x1869752792306432:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 247us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135488.323229:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 111 00000001:00080000:3.0:1783135488.694085:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1783135488.694108:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:2.0:1783135488.954778:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135489.339969:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135489.339979:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135489.340047:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1783135489.340054:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135489.340175:0:11538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813293952:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135489.340265:0:11538:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04ee06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135489.344555:0:11538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813293952:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135489.353806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.353975:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792306560 00000100:00100000:2.0:1783135489.353986:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792306560 00000100:00100000:2.0:1783135489.354047:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 112 00000100:00100000:2.0:1783135489.354058:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+55:10529:x1869752792306560:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135489.354095:0:5794:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135489.354202:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+55:10529:x1869752792306560:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 146us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.354210:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 112 00000100:00100000:0.0:1783135489.360777:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.360944:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792306688 00000100:00100000:2.0:1783135489.360955:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792306688 00000100:00100000:2.0:1783135489.361075:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 113 00000100:00100000:2.0:1783135489.361085:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+55:10529:x1869752792306688:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135489.361160:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361177:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361188:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361250:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361258:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361265:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361327:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361336:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361343:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135489.361399:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783135489.361403:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135489.361416:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361428:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361435:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361442:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361448:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135489.361453:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361460:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361472:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:2.0:1783135489.361492:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135489.361497:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361504:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d0f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361519:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361525:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361530:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361535:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135489.361537:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361543:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361550:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8e8f18315c00) 00010000:00010000:2.0:1783135489.361552:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135489.361555:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361561:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d100 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361575:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361587:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361593:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361598:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135489.361612:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361619:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361627:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:2.0:1783135489.361629:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135489.361632:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.361638:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d107 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.361721:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+55:10529:x1869752792306688:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 Request processed in 636us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.361730:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 113 00000100:00100000:0.0:1783135489.366111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.366206:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792306944 00000100:00100000:3.0:1783135489.366217:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792306944 00000100:00100000:3.0:1783135489.366270:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 114 00000100:00100000:3.0:1783135489.366281:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+55:10529:x1869752792306944:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135489.366316:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135489.366339:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d10e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f82 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366468:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366646:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366660:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135489.366674:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783135489.366788:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366795:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366801:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366807:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135489.366811:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366868:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366882:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:3.0:1783135489.366885:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783135489.366890:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366909:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d115 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366950:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d10e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f82 expref: 57 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366960:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:3.0:1783135489.366963:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135489.366967:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d10e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f82 expref: 57 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.366976:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487200, rc 0) 00000100:00100000:3.0:1783135489.367029:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+56:10529:x1869752792306944:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 750us (927us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1783135489.367037:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 114 00000100:00100000:0.0:1783135489.371751:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.372186:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792307072 00000100:00100000:1.0:1783135489.372196:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792307072 00000100:00100000:1.0:1783135489.372254:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 115 00000100:00100000:1.0:1783135489.372265:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+56:10529:x1869752792307072:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783135489.372316:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783135489.372430:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+56:10529:x1869752792307072:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 166us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135489.372439:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 115 00000100:00100000:0.0:1783135489.377645:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.377854:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792307328 00000100:00100000:3.0:1783135489.377863:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792307328 00000100:00100000:3.0:1783135489.377917:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 116 00000100:00100000:3.0:1783135489.377925:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+56:10529:x1869752792307328:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135489.377944:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135489.377946:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135489.377972:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d0b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f66 expref: 56 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.377989:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:3.0:1783135489.377993:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135489.378018:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d123 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f89 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135489.378402:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1783135489.378924:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d12a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.378938:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.378948:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d12a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.378995:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d123 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f89 expref: 58 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.379009:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d12a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f89 expref: 57 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.379017:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:3.0:1783135489.379021:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135489.379023:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486800, rc 0) 00000100:00100000:3.0:1783135489.379091:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+57:10529:x1869752792307328:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 1167us (1456us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1783135489.379099:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 116 00000100:00100000:0.0:1783135489.383890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.384146:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792307584 00000100:00100000:1.0:1783135489.384155:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792307584 00000100:00100000:1.0:1783135489.384218:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 117 00000100:00100000:1.0:1783135489.384229:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+57:10529:x1869752792307584:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135489.384311:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135489.384338:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d12a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f89 expref: 57 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384357:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:1.0:1783135489.384369:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135489.384400:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384414:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384423:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384438:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384445:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384451:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384539:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384547:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384553:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384566:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135489.384571:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384578:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384587:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:1.0:1783135489.384589:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135489.384593:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384598:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d138 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384608:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384613:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384619:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384623:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121ce00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135489.384626:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384632:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384649:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5ed85136 (ffff8e8f10923500) 00010000:00010000:1.0:1783135489.384651:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135489.384654:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.384660:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d13f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5ed85136 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.385239:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+56:10529:x1869752792307584:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 1008us (1354us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783135489.385248:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 117 00000100:00100000:1.0:1783135489.388645:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.388849:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792307712 00000100:00100000:3.0:1783135489.388858:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792307712 00000100:00100000:3.0:1783135489.388917:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 118 00000100:00100000:3.0:1783135489.388926:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+56:10529:x1869752792307712:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135489.388965:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135489.388990:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d146 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f90 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.389029:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.389042:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.389053:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.389143:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d146 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 58 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.389162:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 57 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.389172:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:3.0:1783135489.389175:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135489.389178:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487a00, rc 0) 00000100:00100000:3.0:1783135489.389242:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+57:10529:x1869752792307712:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 316us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135489.389249:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 118 00000100:00100000:0.0:1783135489.392980:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.393078:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792307968 00000100:00100000:2.0:1783135489.393089:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792307968 00000100:00100000:2.0:1783135489.393151:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 119 00000100:00100000:2.0:1783135489.393162:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+57:10529:x1869752792307968:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135489.393256:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.393288:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.393311:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135489.393589:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1783135489.393612:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 388822796051ns, next at 389822780389ns, rc = 0 00000004:00010000:2.0:1783135489.393704:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd503ca1 reply state 00000000d8794729 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.393714:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135489.393862:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+59:10529:x1869752792307968:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 700us (891us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1783135489.393869:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 119 00010000:00010000:2.0:1783135489.401026:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.401047:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.401055:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.401061:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135489.401067:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.401075:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.401113:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:2.0:1783135489.401116:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135489.401122:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.401128:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d154 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135489.402173:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.402506:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792308096 00000100:00100000:3.0:1783135489.402516:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792308096 00000100:00100000:3.0:1783135489.402615:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 120 00000100:00100000:3.0:1783135489.402626:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+58:10529:x1869752792308096:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135489.402663:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135489.402689:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f97 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.402751:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 59 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.402765:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 59 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.402784:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:3.0:1783135489.402787:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135489.402790:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487200, rc 0) 00000100:00100000:3.0:1783135489.402881:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+59:10529:x1869752792308096:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 256us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135489.402888:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 120 00000100:00100000:0.0:1783135489.418430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.418549:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792308224 00000100:00100000:2.0:1783135489.418559:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792308224 00000100:00100000:2.0:1783135489.418631:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00100000:2.0:1783135489.418641:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792308224:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783135489.418971:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792308224:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 330us (551us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1783135489.418979:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00080000:3.0:1783135489.419375:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135489.421574:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.421670:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792308480 00000100:00100000:3.0:1783135489.421680:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792308480 00000100:00100000:3.0:1783135489.421750:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 30 00000100:00100000:3.0:1783135489.421761:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+59:10529:x1869752792308480:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135489.422060:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+60:10529:x1869752792308480:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 300us (495us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1783135489.422068:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 30 00000100:00100000:1.0:1783135489.424655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.424804:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792308736 00000100:00100000:2.0:1783135489.424849:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792308736 00000100:00100000:2.0:1783135489.424907:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 121 00000100:00100000:2.0:1783135489.424917:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+60:10529:x1869752792308736:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135489.425019:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+60:10529:x1869752792308736:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.425026:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 121 00000100:00100000:0.0:1783135489.427864:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.428078:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792308864 00000100:00100000:2.0:1783135489.428087:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792308864 00000100:00100000:2.0:1783135489.428139:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 122 00000100:00100000:2.0:1783135489.428148:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+60:10529:x1869752792308864:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135489.428182:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135489.428201:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d162 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11f9e expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.428305:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d169 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.428320:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.428331:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135489.428367:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135489.428393:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d169 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.428418:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d162 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f9e expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.428436:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d169 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f9e expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.428445:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:2.0:1783135489.428448:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783135489.428451:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2a00, rc 0) 00000100:00100000:2.0:1783135489.428652:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+61:10529:x1869752792308864:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 504us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.428658:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 122 00000100:00100000:0.0:1783135489.440566:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.440728:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792308992 00000100:00100000:3.0:1783135489.440738:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792308992 00000100:00100000:3.0:1783135489.440844:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:3.0:1783135489.440857:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792308992:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135489.440876:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135489.440897:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fa5 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135489.440925:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487d01, blocks: 0x1 00010000:00010000:3.0:1783135489.440946:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=388s v=(0 0) 00010000:00010000:3.0:1783135489.440951:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135489.440960:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.440978:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 10 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.440992:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486800, rc 0) 00000100:00100000:3.0:1783135489.441060:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d856680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+10:2360:x1869752792308992:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 206us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135489.441066:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:1.0:1783135489.458354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.458471:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792309248 00000100:00100000:2.0:1783135489.458495:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792309248 00000100:00100000:2.0:1783135489.458562:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 123 00000100:00100000:2.0:1783135489.458573:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+61:10529:x1869752792309248:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135489.458725:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+61:10529:x1869752792309248:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 153us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.458733:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 123 00000100:00100000:2.0:1783135489.477926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135489.478186:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792309376 00000100:00100000:0.0:1783135489.478196:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792309376 00000100:00100000:0.0:1783135489.478258:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:0.0:1783135489.478268:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+10:10529:x1869752792309376:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135489.478288:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135489.478317:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fac expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.478351:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.478360:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135489.478364:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135489.478370:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 11 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.478415:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.478450:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 11 pid: 6590 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135489.478464:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d856300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1869752813294080:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135489.478558:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02bf60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135489.485582:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.485754:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792309504 00000100:00100000:1.0:1783135489.485764:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792309504 00010000:00010000:1.0:1783135489.485804:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 12 pid: 6590 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.485877:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 54 00000100:00100000:1.0:1783135489.485886:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+12:2360:x1869752792309504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135489.485900:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135489.485919:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 12 pid: 6590 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.485935:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 12 pid: 6590 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.485973:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135489.485977:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135489.485985:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 12 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.485995:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 12 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.486033:0:6604:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 12 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.486045:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6604:1869752813294208:192.168.201.60@tcp:105: 00000100:00100000:1.0:1783135489.486121:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04fe66c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783135489.486313:0:6589:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d170 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fa5 expref: 12 pid: 6590 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.486330:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d856300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6589:1869752813294080:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135489.486353:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 11 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.486363:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043600, rc 0) 00000100:00100000:2.0:1783135489.486404:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+11:10529:x1869752792309376:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 8137us (8487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.486411:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:1.0:1783135489.492011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.492137:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b83b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6604:1869752813294208:192.168.201.60@tcp:105: 00010000:00010000:2.0:1783135489.492165:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135489.492216:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02ce0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+10:2360:x1869752792309504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6331us (6643us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.492228:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 54 00000100:00100000:0.0:1783135489.493110:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792309632 00000100:00100000:0.0:1783135489.493120:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792309632 00002000:00100000:0.0:1783135489.493168:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e8f37b80000 x1869752792309632/t0(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:660/0 lens 504/0 e 0 to 0 dl 1783135500 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135489.493180:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f37b80000 with x1869752792309632 ext(0->12) 00002000:00010000:0.0:1783135489.493184:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f37b80000 00000100:00100000:0.0:1783135489.493218:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:0.0:1783135489.493227:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c7819a6-778a-4617-af33-00460db74182+10:2361:x1869752792309632:12345-192.168.201.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1783135489.494126:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c7819a6-778a-4617-af33-00460db74182+12:2361:x1869752792309632:12345-192.168.201.60@tcp:4:lhsmtool_posix.0 Request processed in 895us (2120us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783135489.494138:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2 00002000:00100000:0.0:1783135489.494147:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8e8f37b80000 x1869752792309632/t4294967308(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:660/0 lens 504/448 e 0 to 0 dl 1783135500 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135489.494156:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f37b80000 with x1869752792309632 ext(0->12) 00002000:00010000:0.0:1783135489.494160:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f37b80000 00000100:00100000:1.0:1783135489.500376:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.500503:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792309760 00000100:00100000:3.0:1783135489.500520:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792309760 00000100:00100000:3.0:1783135489.500613:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 124 00000100:00100000:3.0:1783135489.500626:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+61:10529:x1869752792309760:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1783135489.626776:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+61:10529:x1869752792309760:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 Request processed in 126143us (126401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135489.626790:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 124 00000001:00080000:2.0:1783135489.627267:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967383 is committed 00000020:00080000:2.0:1783135489.627403:0:5817:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8f05205e40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1783135489.627408:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f0ab1d200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f05205000 00000020:00080000:2.0:1783135489.627412:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f0ab1d500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f3d914000 00000020:00080000:3.0:1783135489.627446:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 2 committed batchid 1 00000020:00080000:3.0:1783135489.627621:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:2.0:1783135489.627665:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967396 is committed 00000004:00080000:2.0:1783135489.627742:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1783135489.627775:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1783135489.627778:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1783135489.627895:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1783135489.629497:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813294336:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783135489.629589:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135489.629865:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813294336 00000100:00100000:0.0:1783135489.629887:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813294336 00000100:00100000:0.0:1783135489.629959:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783135489.629969:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813294336:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783135489.630001:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1783135489.630037:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a487cff, atime: 0x6a487cff, ctime: 0x6a487cff, blocks: 0xb 00010000:00010000:0.0:1783135489.630047:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630064:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1783135489.630069:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135489.630075:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630091:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630101:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630108:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630126:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783135489.630736:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813294336:12345-0@lo:6:osp-syn-1-0.0 Request processed in 766us (1145us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1783135489.630745:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:0.0:1783135489.630776:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135489.630787:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630797:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135489.630802:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630812:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630862:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630870:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d17e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.630889:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135489.630891:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135489.630893:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135489.630923:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1783135489.630928:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1783135489.630943:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f05733800, transno 4294967301 00000004:00080000:0.0:1783135489.630953:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1783135489.630967:0:3313:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8f3d857b80 x1869752813294336/t4294967304(4294967304) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783135505 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783135489.630978:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f3d857b80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1783135489.630984:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d857b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813294336:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1783135489.631810:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135489.632233:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135489.632286:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135489.632316:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813294592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783135489.632388:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135489.632619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000001:00080000:2.0:1783135489.632888:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1783135489.632908:0:5817:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8f089c1540 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1783135489.632913:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f0aaf5100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f01370300 00000020:00080000:2.0:1783135489.632916:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f0aaf5700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f1062b400 00000100:00100000:2.0:1783135489.632956:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813294592 00000100:00100000:2.0:1783135489.632964:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813294592 00000100:00100000:2.0:1783135489.633014:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792309888 00000100:00100000:2.0:1783135489.633017:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792309888 00000100:00100000:2.0:1783135489.633039:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135489.633048:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813294592:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783135489.633233:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783135489.633238:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783135489 00002000:00010000:2.0:1783135489.633240:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783135489.633243:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783135489 -> 1783135489 00002000:00010000:2.0:1783135489.633245:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783135489.633364:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1869752813294592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 247us (916us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783135489.633372:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783135489.633401:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:2.0:1783135489.633422:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+12:2361:x1869752792309888:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1783135489.633458:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1783135489.633494:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f10530e00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1783135489.633501:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813294592:0@lo:2:osp-syn-0-0.0 00000020:00080000:2.0:1783135489.633516:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1783135489.633551:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783135489.637083:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813294464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783135489.637167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135489.637279:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813294464 00000100:00100000:2.0:1783135489.637289:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813294464 00000100:00100000:2.0:1783135489.637358:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135489.637368:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813294464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1783135489.637410:0:8303:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1783135489.637436:0:8303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.637458:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 12 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.637468:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1783135489.637473:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135489.637477:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.637513:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 12 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.637528:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 12 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.637555:0:8303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8303:1869752813294720:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135489.637624:0:8303:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135489.642232:0:8303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8303:1869752813294720:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135489.642262:0:8303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135489.643464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.644424:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792310016 00000100:00100000:3.0:1783135489.644436:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792310016 00010000:00010000:3.0:1783135489.644487:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 13 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135489.644531:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 55 00000100:00100000:3.0:1783135489.644541:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+13:2360:x1869752792310016:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135489.644555:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135489.644561:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 13 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.644574:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 13 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.644602:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875cf40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f0b expref: 13 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.644621:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135489.644625:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135489.644630:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.644658:0:11521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.644753:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135489.644844:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+12:2360:x1869752792310016:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 277us (1358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135489.644852:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 55 00010000:00010000:1.0:1783135489.645411:0:8303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.645423:0:8303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.645446:0:8303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.645454:0:8303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.645472:0:8303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783135489.646650:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d855880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3313:x1869752813294464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9278us (9476us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783135489.646661:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:2.0:1783135489.646972:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f10532680/2, rc 0, transno 4294967310 00000100:00100000:2.0:1783135489.646980:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813294464:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783135489.648114:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135489.648125:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.648137:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135489.648142:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.648152:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.648172:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.648178:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875d185 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.648218:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135489.648219:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135489.648221:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783135489.693736:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1783135489.693781:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1783135489.694097:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d857100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792309888:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 Request processed in 60669us (61473us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.694108:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:3.0:1783135489.698067:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.698177:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792310272 00000100:00100000:2.0:1783135489.698186:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792310272 00000100:00100000:2.0:1783135489.698281:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 125 00000100:00100000:2.0:1783135489.698292:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+15:10529:x1869752792310272:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135489.698348:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135489.698438:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d169 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f9e expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.698459:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:2.0:1783135489.698464:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135489.698565:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.698596:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.698618:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135489.699042:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fbf44c50 reply state 0000000028700306 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.699054:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135489.699159:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+16:10529:x1869752792310272:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 868us (1101us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783135489.699167:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 125 00000100:00100000:1.0:1783135489.704367:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1783135489.704615:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.704628:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.704636:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.704642:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135489.704647:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.704655:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.704674:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:3.0:1783135489.704685:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135489.704690:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135489.704715:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d18c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135489.704753:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792310400 00000100:00100000:3.0:1783135489.704763:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792310400 00000100:00100000:3.0:1783135489.704852:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:3.0:1783135489.704862:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792310400:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783135489.705075:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1783135489.705079:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1783135489 -> 1783135487 00002000:00010000:3.0:1783135489.705081:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783135487 00002000:00010000:3.0:1783135489.705083:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1783135489 -> 1783135487 00002000:00010000:3.0:1783135489.705085:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1783135489.705146:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792310400:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 284us (789us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1783135489.705153:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:3.0:1783135489.715035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.715128:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792310656 00000100:00100000:2.0:1783135489.715144:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792310656 00000100:00100000:2.0:1783135489.715218:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 126 00000100:00100000:2.0:1783135489.715229:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+15:10529:x1869752792310656:12345-192.168.201.60@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783135489.715301:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.715319:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.715328:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.715366:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.715631:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 15 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.715646:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813294848:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135489.715915:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135489.731613:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813294848:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135489.731647:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.732392:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.732668:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792310784 00000100:00100000:1.0:1783135489.732682:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792310784 00010000:00010000:1.0:1783135489.732721:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 16 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.732763:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 56 00000100:00100000:1.0:1783135489.732773:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+16:2360:x1869752792310784:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135489.732788:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135489.732795:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 16 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.732808:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 16 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.732852:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d14d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f90 expref: 16 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.732870:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:1.0:1783135489.732875:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.732885:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.733156:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.733280:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135489.733335:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+15:2360:x1869752792310784:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 564us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135489.733343:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 56 00010000:00010000:2.0:1783135489.734308:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.734320:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.734351:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.734357:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.734364:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.734370:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135489.734374:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.734556:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.734570:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:2.0:1783135489.734573:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783135489.734578:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.734583:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d193 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.734719:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+14:10529:x1869752792310656:12345-192.168.201.60@tcp:55:lhsmtool_posix.0 Request processed in 19488us (19696us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783135489.734729:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 126 00000100:00100000:2.0:1783135489.739766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.739862:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792310912 00000100:00100000:1.0:1783135489.739872:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792310912 00000100:00100000:1.0:1783135489.739934:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:1.0:1783135489.739945:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792310912:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1783135489.739993:0:8303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.740015:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.740024:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1783135489.740028:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135489.740032:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.740066:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.740078:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 7 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.740105:0:8303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8303:1869752813294976:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135489.740190:0:8303:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f012543c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135489.749068:0:8303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8303:1869752813294976:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135489.749111:0:8303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.752031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.754082:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792311040 00000100:00100000:1.0:1783135489.754100:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792311040 00010000:00010000:1.0:1783135489.754151:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 8 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.754193:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:1.0:1783135489.754422:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+8:2361:x1869752792311040:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135489.754445:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135489.754480:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 8 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.754495:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 8 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.754519:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005ab2afd/0xf646e0cda875d177 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fac expref: 8 pid: 6589 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.754536:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135489.754553:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135489.754559:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.754568:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.754608:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135489.754667:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792311040:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 464us (2645us total) trans 0 rc 0/0 00010000:00010000:2.0:1783135489.754955:0:8303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.754967:0:8303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.754996:0:8303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.755004:0:8303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.755024:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.755032:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121ce00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135489.755036:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.755046:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.755058:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.755066:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c136e35/0xf646e0cda875d19a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.755118:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792310912:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 Request processed in 15175us (15363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.755125:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:1.0:1783135489.755388:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:0.0:1783135489.771048:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.771206:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792311296 00000100:00100000:1.0:1783135489.771218:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792311296 00000100:00100000:1.0:1783135489.771285:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 127 00000100:00100000:1.0:1783135489.771295:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+14:10529:x1869752792311296:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783135489.771395:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.771415:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.771428:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.771662:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.771685:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.771713:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.771748:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.771761:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 15 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.771776:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813295104:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135489.771919:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f012543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135489.780442:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.780781:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813295104:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135489.780862:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.781036:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792311424 00000100:00100000:2.0:1783135489.781044:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792311424 00010000:00010000:2.0:1783135489.781086:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 16 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.781126:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 58 00000100:00100000:2.0:1783135489.781149:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+16:2361:x1869752792311424:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135489.781166:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135489.781174:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 16 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.781187:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 16 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.781373:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d15b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f97 expref: 16 pid: 9499 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.781399:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:2.0:1783135489.781404:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.781415:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.781422:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.781499:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135489.781566:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+15:2361:x1869752792311424:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 418us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135489.781574:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 58 00010000:00010000:1.0:1783135489.786056:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.786074:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135489.786299:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1783135489.786475:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1783135489.786522:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1783135489.786646:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1869752813295232:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783135489.786725:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135489.786765:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0598a480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135489.786965:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813295232 00000100:00100000:3.0:1783135489.786982:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813295232 00000100:00100000:3.0:1783135489.787060:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783135489.787072:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1869752813295232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135489.787217:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1869752813295232:12345-0@lo:1000:mdt00_002.0 Request processed in 147us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135489.787227:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135489.787304:0:5796:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1783135489.787311:0:5796:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1783135489.787326:0:5796:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f10530e00, transno 4294967309 00000100:00100000:1.0:1783135489.787386:0:5796:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8f10532680 x1869752813294464/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783135505 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135489.787398:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1869752813295232:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1783135489.787918:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1783135489.787979:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1869752813295360:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783135489.788023:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135489.788057:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02cc0300 going to sleep for 11 seconds 00000100:00100000:3.0:1783135489.788110:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813295360 00000100:00100000:3.0:1783135489.788120:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813295360 00000100:00100000:3.0:1783135489.788170:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135489.788192:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1869752813295360:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135489.788547:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5796:x1869752813295360:12345-0@lo:1000:mdt00_002.0 Request processed in 355us (523us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1783135489.788555:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135489.790508:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1869752813295360:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1783135489.790563:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790574:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790581:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790587:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135489.790592:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790600:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790620:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f08840800) 00010000:00010000:1.0:1783135489.790624:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135489.790646:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790652:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d1a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790689:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790697:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790703:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790709:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135489.790711:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790717:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790726:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135489.790728:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135489.790735:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f7b expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790747:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f7b expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790756:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f7b expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.790806:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f7b expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.790854:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813295488:192.168.201.60@tcp:105: 00000100:00100000:1.0:1783135489.791238:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f012543c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135489.803355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.803476:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9de300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813295488:192.168.201.60@tcp:105: 00010000:00010000:1.0:1783135489.803508:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803520:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d0eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803558:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803574:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803585:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803596:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803602:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803609:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803631:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135489.803636:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803642:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803655:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135489.803659:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135489.803662:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803668:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d1af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803680:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803686:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803691:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803696:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135489.803699:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803704:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803724:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135489.803727:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135489.803730:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.803735:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d1a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135489.804462:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792311552 00000100:00100000:3.0:1783135489.804491:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792311552 00000100:00100000:3.0:1783135489.804583:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 31 00000100:00100000:3.0:1783135489.804596:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+19:10527:x1869752792311552:12345-192.168.201.60@tcp:49:lfs.0 00000100:00100000:3.0:1783135489.805035:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+19:10527:x1869752792311552:12345-192.168.201.60@tcp:49:lfs.0 Request processed in 441us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135489.805044:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 31 00000100:00100000:1.0:1783135489.806455:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d856300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+18:10529:x1869752792311296:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 35147us (35407us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1783135489.806470:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 127 00000020:00080000:1.0:1783135489.806477:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1783135489.807933:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135489.807942:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135489.808440:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1783135489.808450:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135489.817691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135489.817761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.817874:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792311808 00000100:00100000:2.0:1783135489.817890:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792311808 00000100:00100000:2.0:1783135489.817951:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 32 00000100:00100000:2.0:1783135489.817961:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26325850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+18:10529:x1869752792311808:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783135489.818402:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792312064 00000100:00100000:0.0:1783135489.818408:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792312064 00000100:00100000:0.0:1783135489.818454:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 128 00000100:00100000:0.0:1783135489.818462:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+19:10527:x1869752792312064:12345-192.168.201.60@tcp:58:lfs.0 00000040:00080000:0.0:1783135489.818748:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1783135489.818874:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+19:10527:x1869752792312064:12345-192.168.201.60@tcp:58:lfs.0 Request processed in 410us (1111us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135489.818882:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 128 00000004:00080000:2.0:1783135489.819577:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1783135489.819688:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1783135489.819738:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.819757:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.819769:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.819779:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.819786:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.819793:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.819810:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783135489.819923:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26325850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+20:10529:x1869752792311808:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 1960us (2257us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1783135489.819933:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 32 00000020:00080000:2.0:1783135489.819937:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783135489.820991:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135489.821001:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.821011:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135489.821017:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.821044:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.821060:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8e8f18315c00) 00010000:00010000:0.0:1783135489.821063:0:6603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783135489.821067:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.821072:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.821093:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135489.821095:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135489.821097:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135489.905733:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135489.905859:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792312192 00000100:00100000:2.0:1783135489.905868:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792312192 00000100:00100000:2.0:1783135489.905913:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 129 00000100:00100000:2.0:1783135489.905920:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+20:10531:x1869752792312192:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135489.905941:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135489.905970:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d1bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fb3 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906023:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906034:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906042:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906051:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906055:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906059:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906313:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906321:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906327:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906352:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 21 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135489.906371:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 21 pid: 5796 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135489.906398:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d13ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813295616:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135489.906488:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135489.912115:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d13ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813295616:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135489.912151:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135489.922183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135489.924535:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792312448 00000100:00100000:0.0:1783135489.924551:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792312448 00000100:00100000:0.0:1783135489.924630:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:0.0:1783135489.924642:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+22:5575:x1869752792312448:12345-192.168.201.60@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783135489.924948:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+23:5575:x1869752792312448:12345-192.168.201.60@tcp:35:ldlm_bl.0 Request processed in 305us (2776us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1783135489.924957:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:3.0:1783135489.928104:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135489.931488:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792312576 00000100:00100000:1.0:1783135489.931505:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792312576 00010000:00010000:1.0:1783135489.931559:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 23 pid: 5796 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135489.931620:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 59 00000100:00100000:1.0:1783135489.931631:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+23:2363:x1869752792312576:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135489.931650:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135489.931657:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 23 pid: 5796 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.931673:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 23 pid: 5796 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.931699:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d0dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f74 expref: 23 pid: 5796 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.931734:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135489.931739:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.931748:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.931755:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135489.931797:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135489.931920:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+22:2363:x1869752792312576:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 289us (3826us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135489.931927:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 59 00010000:00010000:0.0:1783135489.932799:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.932846:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135489.932895:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1783135489.932900:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135489.932938:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.932953:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.932964:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.932971:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.932978:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.932985:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135489.932989:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.932997:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933010:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:0.0:1783135489.933014:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135489.933018:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933024:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933039:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933046:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933059:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933064:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135489.933067:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933075:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933083:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8e8f18315800) 00010000:00010000:0.0:1783135489.933086:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135489.933089:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933095:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d1cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933136:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d1bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fb3 expref: 22 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933152:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fb3 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135489.933160:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:0.0:1783135489.933162:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135489.933166:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2a00, rc 0) 00000100:00100000:0.0:1783135489.933231:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+21:10531:x1869752792312192:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 27310us (27506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135489.933255:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 129 00010000:00010000:0.0:1783135489.978059:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135490.695418:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135490.695441:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813295744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135490.695515:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135490.695581:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813295744 00000100:00100000:1.0:1783135490.695588:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813295744 00000100:00100000:1.0:1783135490.695635:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783135490.695644:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813295744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783135490.696976:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135490.697770:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813295744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2119us (2247us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135490.697782:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783135490.698018:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813295744:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1783135490.810037:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135490.810047:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135490.810084:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1783135490.810092:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135490.810233:0:11538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10530e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813295872:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135490.810325:0:11538:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02bf6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135490.821016:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135490.821035:0:11538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10530e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813295872:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135490.821060:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792312704 00000100:00100000:2.0:1783135490.821068:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792312704 00000100:00100000:2.0:1783135490.821133:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 130 00000100:00100000:2.0:1783135490.821144:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+21:10542:x1869752792312704:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135490.821192:0:9499:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135490.821292:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+21:10542:x1869752792312704:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 149us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135490.821299:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 130 00000100:00080000:2.0:1783135490.821323:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135490.831257:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135490.832348:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792312960 00000100:00100000:2.0:1783135490.832370:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792312960 00000100:00100000:2.0:1783135490.832439:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 131 00000100:00100000:2.0:1783135490.832450:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+21:10542:x1869752792312960:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135490.832471:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135490.832500:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d1d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fba expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135490.832616:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d1e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135490.832632:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135490.832645:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d1e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135490.832657:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783135490.832793:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d1d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fba expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135490.832839:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d1e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fba expref: 23 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135490.832858:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:2.0:1783135490.832861:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135490.832865:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3200, rc 0) 00000100:00100000:2.0:1783135490.832929:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+23:10542:x1869752792312960:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 481us (1683us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1783135490.832937:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 131 00000100:00100000:1.0:1783135490.842673:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135490.842785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135490.842853:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792313216 00000100:00100000:1.0:1783135490.842863:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792313216 00000100:00100000:1.0:1783135490.842917:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 132 00000100:00100000:1.0:1783135490.842926:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+23:10542:x1869752792313216:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783135490.843031:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843052:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843064:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843283:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843293:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843301:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843307:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121dc00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135490.843312:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843321:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843333:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:1.0:1783135490.843344:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135490.843349:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135490.843367:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d1ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135490.843532:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+24:10542:x1869752792313216:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 604us (744us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1783135490.843543:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 132 00000100:00100000:3.0:1783135490.843593:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792313344 00000100:00100000:3.0:1783135490.843599:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792313344 00000100:00100000:3.0:1783135490.843655:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:3.0:1783135490.843665:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+24:2362:x1869752792313344:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135490.843678:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000040:00080000:1.0:1783135490.843682:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135490.843687:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1783135490.843693:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d1e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fba expref: 24 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135490.843706:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:3.0:1783135490.843710:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135490.843735:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+23:2362:x1869752792313344:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 73us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135490.843802:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00000040:00080000:1.0:1783135490.844205:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783135490.844213:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135490.848923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135490.849108:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792313600 00000100:00100000:0.0:1783135490.849118:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792313600 00000100:00100000:0.0:1783135490.849175:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 34 00000100:00100000:0.0:1783135490.849200:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+23:10542:x1869752792313600:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783135490.849452:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+24:10542:x1869752792313600:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 268us (539us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1783135490.849460:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 34 00000040:00080000:3.0:1783135490.882338:0:11908:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135490.882350:0:11908:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135490.882412:0:11908:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1783135490.882418:0:11908:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1783135491.002568:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135491.152974:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135491.153173:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792313856 00000100:00100000:2.0:1783135491.153184:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792313856 00000100:00100000:2.0:1783135491.153246:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 133 00000100:00100000:2.0:1783135491.153257:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+24:10555:x1869752792313856:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135491.153292:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135491.153311:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d1f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fc1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.153424:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.153441:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.153453:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135491.153465:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783135491.153595:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d1f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fc1 expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.153613:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fc1 expref: 26 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.153621:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:2.0:1783135491.153624:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783135491.153627:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2c00, rc 0) 00000100:00100000:2.0:1783135491.154533:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10530e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+26:10555:x1869752792313856:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1271us (1562us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1783135491.154544:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 133 00000100:00100000:3.0:1783135491.170484:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135491.170890:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792313984 00000100:00100000:2.0:1783135491.170901:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792313984 00000100:00100000:2.0:1783135491.170992:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 134 00000100:00100000:2.0:1783135491.171013:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+26:10555:x1869752792313984:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:2.0:1783135491.171090:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171108:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171119:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171146:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171153:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171160:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171166:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135491.171170:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171178:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171190:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:2.0:1783135491.171209:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135491.171214:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135491.171221:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d20a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135491.171296:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+26:10555:x1869752792313984:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 285us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135491.171304:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 134 00000100:00100000:0.0:1783135491.334590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135491.335016:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792314112 00000100:00100000:3.0:1783135491.335027:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792314112 00000100:00100000:3.0:1783135491.335117:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:3.0:1783135491.335130:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2362:x1869752792314112:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:3.0:1783135491.335152:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135491.335176:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875d211 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fc8 expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135491.335204:0:6589:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a487cff, atime: 0x6a487cff, ctime: 0x6a487cff, blocks: 0xb 00010000:00010000:3.0:1783135491.335225:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=390s v=(0 0) 00010000:00010000:3.0:1783135491.335229:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135491.335239:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875d211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fc8 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135491.335260:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875d211 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fc8 expref: 7 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135491.335275:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486600, rc 0) 00000100:00100000:3.0:1783135491.335360:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2362:x1869752792314112:12345-192.168.201.60@tcp:101:cat.0 Request processed in 233us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135491.335383:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00080000:2.0:1783135491.335472:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135491.342879:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135491.342991:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792314240 00000100:00100000:2.0:1783135491.343002:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792314240 00002000:00100000:2.0:1783135491.343053:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8e8f3db58000 x1869752792314240/t0(0) o3->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:662/0 lens 488/0 e 0 to 0 dl 1783135502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135491.343064:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3db58000 with x1869752792314240 ext(0->4095) 00002000:00010000:2.0:1783135491.343086:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3db58000 00000100:00100000:2.0:1783135491.343119:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:2.0:1783135491.343129:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792314240:12345-192.168.201.60@tcp:3:cat.0 00000100:00100000:2.0:1783135491.343383:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792314240:12345-192.168.201.60@tcp:3:cat.0 Request processed in 254us (526us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783135491.343391:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3 00002000:00100000:2.0:1783135491.343397:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8e8f3db58000 x1869752792314240/t0(0) o3->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:662/0 lens 488/4536 e 0 to 0 dl 1783135502 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135491.343407:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3db58000 with x1869752792314240 ext(0->4095) 00002000:00010000:2.0:1783135491.343410:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3db58000 00010000:00010000:0.0:1783135492.038102:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135492.087354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135492.087399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135492.087435:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135492.087457:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135492.087480:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135492.087551:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792314624 00000100:00100000:2.0:1783135492.087562:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792314624 00000100:00100000:2.0:1783135492.087625:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792314752 00000100:00100000:2.0:1783135492.087629:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792314752 00000100:00100000:2.0:1783135492.087666:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 78 00000100:00100000:2.0:1783135492.087677:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792314624:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135492.087763:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792314624:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 87us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135492.087772:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 78 00000100:00100000:2.0:1783135492.087793:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:2.0:1783135492.087800:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792314752:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135492.087851:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2361:x1869752792314752:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135492.087857:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:2.0:1783135492.087875:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792314880 00000100:00100000:2.0:1783135492.087877:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792314880 00000100:00100000:2.0:1783135492.087904:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792314496 00000100:00100000:2.0:1783135492.087906:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792314496 00000100:00100000:2.0:1783135492.087926:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 143 00000100:00100000:2.0:1783135492.087932:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792314880:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135492.087958:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792314880:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135492.087964:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 143 00000100:00100000:2.0:1783135492.087974:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 144 00000100:00100000:2.0:1783135492.087981:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+26:2361:x1869752792314496:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135492.088007:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+26:2361:x1869752792314496:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 27us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135492.088013:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 144 00000100:00080000:2.0:1783135492.088032:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135492.088036:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135492.088162:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792314368 00000100:00100000:3.0:1783135492.088168:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792314368 00000100:00100000:3.0:1783135492.088210:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 289 00000100:00100000:3.0:1783135492.088217:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792314368:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135492.088244:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792314368:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 28us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135492.088250:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 289 00000100:00100000:3.0:1783135492.730303:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783135492.730337:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813296000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135492.730412:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135492.730520:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813296000 00000100:00100000:1.0:1783135492.730528:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813296000 00000100:00100000:1.0:1783135492.730601:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783135492.730612:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869752813296000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135492.730651:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135492.730700:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869752813296000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135492.730708:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783135492.730754:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813296000:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783135492.731013:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783135493.050219:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135493.268250:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813296512:0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.268335:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135493.268396:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783135493.268403:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813296128:0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.268433:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135493.268457:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813296640:0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.268486:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135493.268514:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813296256:0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.268539:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135493.268558:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135493.268563:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813296384:0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.268585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135493.268627:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813296512 00000100:00100000:3.0:1783135493.268635:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813296512 00000100:00100000:3.0:1783135493.268684:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813296256 00000100:00100000:3.0:1783135493.268688:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813296256 00000100:00100000:3.0:1783135493.268701:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813296384 00000100:00100000:3.0:1783135493.268703:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813296384 00000100:00100000:3.0:1783135493.268724:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783135493.268732:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813296512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.268784:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813296512:12345-0@lo:400:kworker.0 Request processed in 52us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135493.268791:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1783135493.268811:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783135493.268838:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813296256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.268872:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813296256:12345-0@lo:400:kworker.0 Request processed in 55us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135493.268878:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783135493.268890:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783135493.268896:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813296384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.268921:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813296384:12345-0@lo:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135493.268928:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783135493.268945:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813296640 00000100:00100000:3.0:1783135493.268950:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813296640 00000100:00100000:3.0:1783135493.270212:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1783135493.270230:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813296640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.270324:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813296640:12345-0@lo:400:kworker.0 Request processed in 91us (1827us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135493.270346:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1783135493.270390:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135493.270397:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135493.270443:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813296640:0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.270458:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813296512:0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.270496:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813296384:0@lo:400:kworker.0 00000100:00100000:3.0:1783135493.270509:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813296256:0@lo:400:kworker.0 00000100:00100000:1.0:1783135493.279739:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813296128 00000100:00100000:1.0:1783135493.279756:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813296128 00000100:00100000:1.0:1783135493.279838:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783135493.279848:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3313:x1869752813296128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135493.279947:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3313:x1869752813296128:12345-0@lo:400:kworker.0 Request processed in 100us (11512us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135493.279965:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1783135493.282919:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813296128:0@lo:400:kworker.0 00000001:00080000:3.0:1783135493.877714:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:1.0:1783135494.074310:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783135494.897391:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1783135494.897442:0:5817:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8f0598a3c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1783135494.897448:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f3d04e600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f0598a480 00000020:00080000:2.0:1783135494.897452:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f3d04eb00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f3cba5c00 00000001:00080000:2.0:1783135494.897491:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1783135494.897507:0:5817:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1783135494.897513:0:5817:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 2 batchid updated 00000020:00080000:3.0:1783135494.898370:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:3.0:1783135494.902750:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:0.0:1783135494.930304:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:0.0:1783135494.930325:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:0.0:1783135494.930332:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00010000:00010000:1.0:1783135495.099828:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135495.802968:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135495.803002:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813296768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135495.803100:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135495.808832:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813296768 00000100:00100000:1.0:1783135495.808852:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813296768 00000100:00100000:1.0:1783135495.808942:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783135495.808955:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813296768:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783135495.808962:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1783135495.809013:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135495.809136:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813296768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (6035us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135495.809144:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135495.809341:0:3312:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1783135495.809350:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f3d857b80, transno 4294967304 00000100:00100000:3.0:1783135495.809387:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813296768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783135496.126680:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135497.019753:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135497.019768:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135497.020185:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1783135497.020194:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783135497.146368:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135497.157335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135497.162073:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792315008 00000100:00100000:2.0:1783135497.162097:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792315008 00000100:00100000:3.0:1783135497.162633:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 135 00000100:00100000:3.0:1783135497.162651:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+13:10216:x1869752792315008:12345-192.168.201.60@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1783135497.162859:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+13:10216:x1869752792315008:12345-192.168.201.60@tcp:60:lhsmtool_posix.0 Request processed in 214us (5539us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135497.162868:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 135 00000100:00080000:2.0:1783135497.165092:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135497.168728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135497.168870:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792315264 00000100:00100000:3.0:1783135497.168884:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792315264 00000100:00100000:3.0:1783135497.168957:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 35 00000100:00100000:3.0:1783135497.168969:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+13:10216:x1869752792315264:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135497.169662:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+14:10216:x1869752792315264:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 692us (944us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1783135497.169672:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 35 00000100:00100000:1.0:1783135497.207903:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135497.207957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135497.207997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135497.208044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135497.208087:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792315776 00000100:00100000:1.0:1783135497.208100:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792315776 00000100:00100000:1.0:1783135497.208184:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 148 00000100:00100000:1.0:1783135497.208196:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792315776:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135497.208318:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792315776:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 123us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135497.208326:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 148 00000100:00100000:0.0:1783135497.208568:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792315648 00000100:00100000:0.0:1783135497.208573:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792315648 00000100:00100000:0.0:1783135497.208622:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792315520 00000100:00100000:0.0:1783135497.208626:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792315520 00000100:00100000:0.0:1783135497.208652:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 81 00000100:00100000:0.0:1783135497.208661:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792315648:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135497.208700:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792315648:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 41us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135497.208707:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 81 00000100:00100000:0.0:1783135497.208720:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 82 00000100:00100000:0.0:1783135497.208726:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792315520:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135497.208750:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d857b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792315520:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 25us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135497.208757:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 82 00000100:00100000:2.0:1783135497.209062:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792315392 00000100:00100000:2.0:1783135497.209068:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792315392 00000100:00100000:2.0:1783135497.209111:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 291 00000100:00100000:2.0:1783135497.209119:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792315392:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135497.209151:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792315392:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 34us (1268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135497.209158:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 291 00000100:00080000:2.0:1783135497.209191:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135497.209196:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135497.209199:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135497.594186:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135497.594406:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792315904 00000100:00100000:0.0:1783135497.594420:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792315904 00000100:00100000:0.0:1783135497.594498:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 136 00000100:00100000:0.0:1783135497.594511:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:11007:x1869752792315904:12345-192.168.201.60@tcp:101:lsof.0 00010000:00010000:0.0:1783135497.594540:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135497.594578:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fcf expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135497.594690:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135497.594707:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135497.594725:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135497.596643:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783135497.596657:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135497.596785:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135497.596846:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135497.596870:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 6 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135497.596881:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:0.0:1783135497.596885:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135497.596890:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042000, rc 0) 00000100:00100000:0.0:1783135497.597593:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:11007:x1869752792315904:12345-192.168.201.60@tcp:101:lsof.0 Request processed in 3079us (3417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135497.597605:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 136 00000100:00100000:1.0:1783135497.850177:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135497.850291:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813296896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135497.850434:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135497.850727:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813296896 00000100:00100000:2.0:1783135497.850739:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813296896 00000100:00100000:2.0:1783135497.850857:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783135497.850870:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813296896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135497.850945:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135497.851008:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813296896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135497.851017:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1783135497.851162:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135497.851200:0:3311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1783135497.851206:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f10532680, transno 4294967310 00000004:00080000:1.0:1783135497.851229:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1783135497.851284:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813296896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135498.170497:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135498.367327:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cf57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813297408:0@lo:400:kworker.0 00000100:00100000:1.0:1783135498.367327:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813297024:0@lo:400:kworker.0 00000100:00100000:3.0:1783135498.367412:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813297152:0@lo:400:kworker.0 00000100:00100000:0.0:1783135498.367468:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cf55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813297280:0@lo:400:kworker.0 00000100:00100000:2.0:1783135498.368345:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135498.368469:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813297408 00000100:00100000:2.0:1783135498.368481:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813297408 00000100:00100000:2.0:1783135498.369708:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1783135498.369729:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813297408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135498.370075:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813297408:12345-0@lo:400:kworker.0 Request processed in 353us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135498.370084:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1783135498.370125:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135498.370174:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cf57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813297408:0@lo:400:kworker.0 00000100:00100000:3.0:1783135498.373327:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135498.375127:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135498.375516:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813297152 00000100:00100000:2.0:1783135498.375529:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813297152 00000100:00100000:2.0:1783135498.375602:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813297280 00000100:00100000:2.0:1783135498.375606:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813297280 00000100:00100000:2.0:1783135498.375649:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783135498.375660:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813297152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135498.375747:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813297152:12345-0@lo:400:kworker.0 Request processed in 88us (2432us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135498.375756:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1783135498.375776:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1783135498.375783:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813297280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135498.375861:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813297280:12345-0@lo:400:kworker.0 Request processed in 78us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135498.375879:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1783135498.375904:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135498.376346:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813297152:0@lo:400:kworker.0 00000100:00100000:0.0:1783135498.377135:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cf55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813297280:0@lo:400:kworker.0 00000100:00100000:1.0:1783135498.378134:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135498.378401:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cf54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813297536:0@lo:400:kworker.0 00000100:00100000:1.0:1783135498.378454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135498.380340:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813297536 00000100:00100000:3.0:1783135498.380361:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813297536 00000100:00100000:3.0:1783135498.380496:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783135498.380509:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813297536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135498.380630:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813297536:12345-0@lo:400:kworker.0 Request processed in 124us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135498.380639:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1783135498.380703:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cf54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813297536:0@lo:400:kworker.0 00000100:00080000:0.0:1783135498.380883:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135498.382488:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813297024 00000100:00100000:2.0:1783135498.382506:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813297024 00000100:00100000:2.0:1783135498.382628:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:2.0:1783135498.382641:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3313:x1869752813297024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135498.382750:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3313:x1869752813297024:12345-0@lo:400:kworker.0 Request processed in 111us (4622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135498.382759:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1783135498.382866:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c59880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3313:1869752813297024:0@lo:400:kworker.0 00010000:00010000:0.0:1783135499.194721:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783135500.021627:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1783135500.021660:0:5817:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1783135500.021808:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1783135500.021841:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1783135500.223906:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135500.925509:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135500.925544:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813297664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135500.925661:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135500.925917:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813297664 00000100:00100000:2.0:1783135500.925928:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813297664 00000100:00100000:2.0:1783135500.926012:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783135500.926025:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813297664:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783135500.926044:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1783135500.926079:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135500.926149:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813297664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135500.926158:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135500.929645:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813297664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783135501.242084:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783135502.038241:0:12113:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:24:59 (1783135499) 00010000:00010000:0.0:1783135502.266244:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135502.326710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135502.326746:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135502.326795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135502.326857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135502.326893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135502.326926:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792316544 00000100:00100000:3.0:1783135502.326936:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792316544 00000100:00100000:3.0:1783135502.327102:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792316160 00000100:00100000:3.0:1783135502.327107:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792316160 00000100:00100000:3.0:1783135502.327138:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 152 00000100:00100000:3.0:1783135502.327148:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2363:x1869752792316544:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135502.327250:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2363:x1869752792316544:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 100us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135502.327257:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 152 00000100:00100000:3.0:1783135502.327276:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 153 00000100:00100000:3.0:1783135502.327284:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+13:2363:x1869752792316160:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135502.327390:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+13:2363:x1869752792316160:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 43us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135502.327399:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 153 00000100:00100000:3.0:1783135502.327426:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792316288 00000100:00100000:3.0:1783135502.327429:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792316288 00000100:00100000:1.0:1783135502.327504:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792316416 00000100:00100000:1.0:1783135502.327516:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792316416 00000100:00100000:3.0:1783135502.327527:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00100000:3.0:1783135502.327540:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792316288:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135502.327579:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792316288:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 41us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135502.327586:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 85 00000100:00100000:1.0:1783135502.327604:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792316416:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135502.327674:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792316416:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 74us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135502.327694:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00080000:3.0:1783135502.327724:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135502.327729:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135502.327742:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135502.330733:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792316032 00000100:00100000:0.0:1783135502.330753:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792316032 00000100:00100000:0.0:1783135502.330865:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 293 00000100:00100000:0.0:1783135502.330878:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792316032:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135502.330987:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792316032:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 111us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135502.330996:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 293 00000100:00100000:1.0:1783135502.332326:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 85 00000100:00100000:3.0:1783135502.973577:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135502.973649:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cf57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813297792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135502.973803:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135502.974173:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813297792 00000100:00100000:1.0:1783135502.974185:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813297792 00000100:00100000:1.0:1783135502.974269:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783135502.974280:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813297792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135502.974354:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135502.974416:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c234850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813297792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135502.974424:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1783135502.975968:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135502.976110:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cf57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813297792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135503.290725:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135503.482577:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813298176:0@lo:400:kworker.0 00000100:00100000:0.0:1783135503.482599:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813298304:0@lo:400:kworker.0 00000100:00100000:3.0:1783135503.482755:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813297920:0@lo:400:kworker.0 00000100:00100000:2.0:1783135503.483124:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813298048:0@lo:400:kworker.0 00000100:00100000:1.0:1783135503.483810:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135503.483896:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813298176 00000100:00100000:0.0:1783135503.483912:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813298176 00000100:00100000:1.0:1783135503.483964:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135503.484009:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813298304 00000100:00100000:1.0:1783135503.484013:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813298304 00000100:00100000:1.0:1783135503.484049:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783135503.484059:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813298176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135503.484128:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813298176:12345-0@lo:400:kworker.0 Request processed in 70us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135503.484154:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1783135503.484172:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783135503.484178:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813298304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135503.484212:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813298304:12345-0@lo:400:kworker.0 Request processed in 34us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135503.484219:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783135503.484263:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813298304:0@lo:400:kworker.0 00000100:00100000:0.0:1783135503.484264:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813298176:0@lo:400:kworker.0 00000100:00080000:0.0:1783135503.484311:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135503.489241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135503.489339:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813298432:0@lo:400:kworker.0 00000100:00100000:3.0:1783135503.489384:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135503.489864:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135503.489923:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813298048 00000100:00100000:2.0:1783135503.489932:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813298048 00000100:00100000:2.0:1783135503.489989:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783135503.490000:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813298048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135503.490090:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813298048:12345-0@lo:400:kworker.0 Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135503.490099:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783135503.490165:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813298048:0@lo:400:kworker.0 00000100:00100000:1.0:1783135503.492462:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813297920 00000100:00100000:1.0:1783135503.492481:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813297920 00000100:00100000:1.0:1783135503.492580:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783135503.492594:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813297920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135503.492714:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813297920:12345-0@lo:400:kworker.0 Request processed in 123us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135503.492739:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1783135503.492868:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813298432 00000100:00100000:0.0:1783135503.492875:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813298432 00000100:00100000:0.0:1783135503.492939:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1783135503.492948:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813298432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135503.493007:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813298432:12345-0@lo:400:kworker.0 Request processed in 61us (3623us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135503.493021:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1783135503.493154:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813297920:0@lo:400:kworker.0 00000100:00100000:3.0:1783135503.493172:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c8bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813298432:0@lo:400:kworker.0 00000100:00080000:1.0:1783135503.493496:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135503.496558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135503.496654:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792316800 00000100:00100000:0.0:1783135503.496671:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792316800 00000100:00100000:0.0:1783135503.496755:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 137 00000100:00100000:0.0:1783135503.496767:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+13:11272:x1869752792316800:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135503.496803:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135503.496873:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d226 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fd6 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.496983:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.497002:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.497021:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.497041:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.497049:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.497055:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.497715:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875d23b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.497730:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875d23b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.497745:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875d23b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135503.497758:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783135503.498058:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498068:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498075:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498083:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135503.498088:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498096:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498114:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8f032fc400) 00010000:00010000:0.0:1783135503.498117:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135503.498122:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498129:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d22d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498156:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498163:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498177:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498184:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135503.498187:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498193:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498205:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8f1a154700) 00010000:00010000:0.0:1783135503.498207:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135503.498210:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498215:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d234 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498784:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d226 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fd6 expref: 16 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498804:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875d23b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fd6 expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135503.498882:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:0.0:1783135503.498886:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135503.498889:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043400, rc 0) 00000100:00100000:0.0:1783135503.498998:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+15:11272:x1869752792316800:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 2231us (2454us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1783135503.499020:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 137 00000100:00100000:0.0:1783135503.501631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135503.501728:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792316928 00000100:00100000:1.0:1783135503.501742:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792316928 00000100:00100000:1.0:1783135503.501861:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:1.0:1783135503.501873:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+15:2362:x1869752792316928:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135503.501894:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135503.501926:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875d23b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fd6 expref: 15 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135503.501950:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:1.0:1783135503.501955:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135503.502013:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02ce0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+14:2362:x1869752792316928:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 142us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135503.502021:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:2.0:1783135503.505441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135503.505524:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792317056 00000100:00100000:0.0:1783135503.505538:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792317056 00000100:00100000:0.0:1783135503.505669:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 138 00000100:00100000:0.0:1783135503.505683:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+14:11272:x1869752792317056:12345-192.168.201.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783135503.505849:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+14:11272:x1869752792317056:12345-192.168.201.60@tcp:59:lhsmtool_posix.0 Request processed in 169us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135503.505858:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 138 00000040:00080000:1.0:1783135504.187006:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135504.187017:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135504.187638:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1783135504.187648:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783135504.319069:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1783135505.091773:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1783135505.338203:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135505.585357:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135505.585496:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792317184 00000100:00100000:0.0:1783135505.585510:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792317184 00000100:00100000:0.0:1783135505.585668:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 139 00000100:00100000:0.0:1783135505.585682:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+13:11314:x1869752792317184:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135505.585709:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135505.585734:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fdd expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.586188:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.586208:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.586224:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.586250:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.586259:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.586266:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783135505.587098:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783135505.587287:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587300:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587308:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587316:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135505.587321:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587330:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587346:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:0.0:1783135505.587350:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135505.587356:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587363:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d250 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587381:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587388:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587394:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587400:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135505.587546:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587554:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587563:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8f1a154700) 00010000:00010000:0.0:1783135505.587566:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135505.587569:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.587576:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d257 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.588023:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d249 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fdd expref: 14 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.588037:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:0.0:1783135505.588039:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135505.588049:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fdd expref: 14 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.588058:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042400, rc 0) 00000100:00100000:0.0:1783135505.588334:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+13:11314:x1869752792317184:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2654us (2992us total) trans 0 rc 301/301 00000100:00100000:0.0:1783135505.588345:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 139 00000100:00100000:1.0:1783135505.596164:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135505.596249:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792317440 00000100:00100000:2.0:1783135505.596262:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792317440 00000100:00100000:2.0:1783135505.596334:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 140 00000100:00100000:2.0:1783135505.596346:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+13:11314:x1869752792317440:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1783135505.596434:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135505.596471:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875cbc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e16 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.596491:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:2.0:1783135505.596497:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135505.596879:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.596898:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 5 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.596908:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.596951:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 5 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.596977:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 5 pid: 5794 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.596996:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cf54380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813298560:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135505.597130:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135505.601598:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cf54380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813298560:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135505.602063:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.602234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135505.602288:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792317568 00000100:00100000:1.0:1783135505.602312:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792317568 00010000:00010000:1.0:1783135505.602385:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 6 pid: 5794 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135505.602587:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 60 00000100:00100000:1.0:1783135505.602665:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2361:x1869752792317568:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135505.602687:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135505.602695:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 6 pid: 5794 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.602710:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 6 pid: 5794 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783135505.602732:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783135505.602737:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d21f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fcf expref: 6 pid: 5794 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.602753:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:1.0:1783135505.602758:0:11521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.602769:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.602777:0:11521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.602809:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135505.602900:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.602911:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.602943:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.602954:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.602964:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135505.603032:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792317568:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 432us (1618us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135505.603042:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 60 00000004:00200000:2.0:1783135505.607248:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1783135505.607277:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.607290:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.607299:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.607313:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135505.607319:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.607329:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.607354:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f10923c00) 00010000:00010000:2.0:1783135505.607358:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135505.607363:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.607370:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d25e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135505.607396:0:5794:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a42bc9c6 reply state 000000005d838e99 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.607408:0:5794:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135505.607556:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+14:11314:x1869752792317440:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 11205us (11395us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1783135505.607567:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 140 00010000:00010000:3.0:1783135505.620880:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.620905:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.620914:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.620921:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135505.620928:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.620943:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.620969:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8f18315e00) 00010000:00010000:3.0:1783135505.620974:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135505.620980:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.620987:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d265 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135505.663118:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135505.663299:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792317696 00000100:00100000:2.0:1783135505.663314:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792317696 00000100:00100000:2.0:1783135505.663402:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 141 00000100:00100000:2.0:1783135505.663494:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+13:11322:x1869752792317696:12345-192.168.201.60@tcp:101:lctl.0 00010000:00010000:2.0:1783135505.663541:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135505.663568:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d26c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11fe4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.663683:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d273 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.663706:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d273 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.663723:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d273 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135505.663805:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783135505.663856:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135505.663908:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d273 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.663946:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d26c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fe4 expref: 15 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.663972:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d273 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fe4 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.663983:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:2.0:1783135505.663992:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135505.663997:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2200, rc 0) 00000100:00100000:0.0:1783135505.664188:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+14:11322:x1869752792317696:12345-192.168.201.60@tcp:101:lctl.0 Request processed in 697us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135505.664197:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 141 00000100:00100000:3.0:1783135505.686455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135505.686737:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792317824 00000100:00100000:1.0:1783135505.686765:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792317824 00000100:00100000:2.0:1783135505.686872:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 142 00000100:00100000:2.0:1783135505.686894:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+14:11328:x1869752792317824:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135505.686920:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135505.687036:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d27a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11feb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687128:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687141:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687150:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687161:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687166:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687170:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687307:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875d28f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687312:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875d28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687316:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875d28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135505.687346:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783135505.687349:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135505.687378:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875d28f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687390:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687395:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687489:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687494:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135505.687498:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687503:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687517:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:1.0:1783135505.687521:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135505.687526:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687531:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687547:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687553:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687557:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687567:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121dc00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135505.687570:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687576:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687581:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8e8f10923700) 00010000:00010000:1.0:1783135505.687583:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135505.687585:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687589:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d288 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687712:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d27a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11feb expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687728:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875d28f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11feb expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.687734:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135505.687736:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783135505.687737:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d800, rc 0) 00000100:00100000:0.0:1783135505.687920:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+15:11328:x1869752792317824:12345-192.168.201.60@tcp:101:bash.0 Request processed in 1034us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135505.687929:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 142 00000100:00100000:2.0:1783135505.692071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135505.693198:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792318080 00000100:00100000:0.0:1783135505.693216:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792318080 00000100:00100000:0.0:1783135505.693294:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 143 00000100:00100000:0.0:1783135505.693304:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+15:11328:x1869752792318080:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135505.693328:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135505.693354:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d296 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ff2 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.693548:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.693566:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.693580:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.695299:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.695325:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.695339:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135505.696473:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1783135505.696664:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696678:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696687:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696726:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696733:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696740:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696746:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135505.696751:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696774:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696787:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135505.696790:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135505.696795:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.696801:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d29d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135505.696963:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003ca2507b reply state 000000007b5c2b29 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135505.697037:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135505.697242:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d296 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 18 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.697259:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 17 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.697267:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135505.697270:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135505.697272:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043800, rc 0) 00000100:00100000:0.0:1783135505.697395:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:11328:x1869752792318080:12345-192.168.201.60@tcp:101:bash.0 Request processed in 4090us (5339us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1783135505.697405:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 143 00010000:00010000:3.0:1783135505.698759:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.698777:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.698786:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.698792:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135505.698797:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.698805:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.698939:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f1a154700) 00010000:00010000:3.0:1783135505.698944:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135505.698967:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.698984:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d2a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.700614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135505.700992:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792318208 00000100:00100000:0.0:1783135505.701008:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792318208 00000100:00080000:2.0:1783135505.701341:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135505.701390:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:0.0:1783135505.701402:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792318208:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135505.701423:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135505.701442:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab11ff9 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135505.701469:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783135505.701490:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=405s v=(0 0) 00010000:00010000:0.0:1783135505.701495:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135505.701505:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.701523:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 6 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.701537:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042600, rc 0) 00000100:00100000:0.0:1783135505.701605:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792318208:12345-192.168.201.60@tcp:101:bash.0 Request processed in 206us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135505.701613:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:1.0:1783135505.706059:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135505.706340:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792318336 00000100:00100000:0.0:1783135505.706351:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792318336 00000100:00100000:0.0:1783135505.706414:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:0.0:1783135505.706425:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:11328:x1869752792318336:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135505.706444:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135505.706463:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12000 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.706514:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.706524:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135505.706528:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135505.706534:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.706569:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 7 pid: 6587 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.706580:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 7 pid: 6587 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135505.706590:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fd44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1869752813298688:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135505.706714:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08b88540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135505.709692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135505.709753:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fd44a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6590:1869752813298688:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135505.709790:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 7 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.709811:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043e00, rc 0) 00000100:00100000:2.0:1783135505.709937:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792318464 00000100:00100000:2.0:1783135505.709946:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792318464 00010000:00010000:2.0:1783135505.710002:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 8 pid: 6587 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135505.710179:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+8:11328:x1869752792318336:12345-192.168.201.60@tcp:101:bash.0 Request processed in 3755us (4132us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135505.710187:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:2.0:1783135505.710269:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:2.0:1783135505.710280:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792318464:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135505.710297:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135505.710320:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 7 pid: 6587 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.710333:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 7 pid: 6587 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.710356:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000addefe20/0xf646e0cda875d2b9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff9 expref: 7 pid: 6587 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.710371:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135505.710375:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135505.710383:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.710394:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.710428:0:5781:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.710450:0:5781:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1869752813298816:192.168.201.60@tcp:105: 00000100:00100000:2.0:1783135505.710505:0:5781:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f082620c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135505.713327:0:5781:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5781:1869752813298816:192.168.201.60@tcp:105: 00010000:00010000:2.0:1783135505.713356:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135505.713431:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792318464:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 3151us (3758us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135505.713442:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:2.0:1783135505.715061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135505.715293:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792318720 00000100:00100000:1.0:1783135505.715302:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792318720 00000100:00100000:1.0:1783135505.715362:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 36 00000100:00100000:1.0:1783135505.715372:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+17:11328:x1869752792318720:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1783135505.715741:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+18:11328:x1869752792318720:12345-192.168.201.60@tcp:35:bash.0 Request processed in 369us (688us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1783135505.715749:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 36 00000100:00100000:3.0:1783135505.766966:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135505.767141:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792318976 00000100:00100000:0.0:1783135505.767156:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792318976 00000100:00100000:0.0:1783135505.767258:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 144 00000100:00100000:0.0:1783135505.767271:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+18:11338:x1869752792318976:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135505.767303:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135505.767330:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d2c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12007 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135505.767723:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783135505.768381:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d2c7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12007 expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.768480:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:1.0:1783135505.768485:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135505.768493:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d2c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12007 expref: 20 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.768513:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043200, rc 0) 00000100:00100000:1.0:1783135505.768901:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+19:11338:x1869752792318976:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1630us (1946us total) trans 4294967419 rc 301/301 00000100:00100000:1.0:1783135505.768911:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 144 00000100:00100000:0.0:1783135505.772516:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135505.772796:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792319232 00000100:00100000:1.0:1783135505.772809:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792319232 00000100:00100000:1.0:1783135505.773051:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00100000:1.0:1783135505.773063:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+19:11338:x1869752792319232:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1783135505.773471:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+20:11338:x1869752792319232:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 409us (969us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1783135505.773481:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00100000:2.0:1783135505.831669:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135505.831808:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792319360 00000100:00100000:1.0:1783135505.831870:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792319360 00000100:00100000:1.0:1783135505.831937:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 145 00000100:00100000:1.0:1783135505.831948:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+20:11343:x1869752792319360:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135505.832001:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135505.832028:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d2d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1200e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.832130:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d2dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.832148:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.832162:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135505.832250:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1783135505.832255:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135505.832279:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d2dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.832310:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d2d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1200e expref: 22 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.832333:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d2dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1200e expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.832343:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135505.832346:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135505.832351:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c600, rc 0) 00000100:00100000:1.0:1783135505.832453:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+21:11343:x1869752792319360:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 507us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135505.832462:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 145 00000100:00100000:3.0:1783135505.843920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135505.844202:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792319616 00000100:00100000:2.0:1783135505.844217:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792319616 00000100:00100000:2.0:1783135505.844299:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 146 00000100:00100000:2.0:1783135505.844311:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+21:11343:x1869752792319616:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135505.844337:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135505.844366:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d2e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12015 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.844519:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d2ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.844536:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d2ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.844550:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d2ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135505.844590:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783135505.844786:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d2e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12015 expref: 24 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.844810:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d2ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12015 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.844870:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:2.0:1783135505.844873:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135505.844879:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3e00, rc 0) 00000100:00100000:2.0:1783135505.844967:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+23:11343:x1869752792319616:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 658us (1062us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1783135505.844976:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 146 00000100:00100000:3.0:1783135505.849127:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135505.850331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135505.850418:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792320000 00000100:00100000:2.0:1783135505.850431:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792320000 00000100:00100000:2.0:1783135505.850512:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:2.0:1783135505.850524:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+23:2363:x1869752792320000:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135505.850546:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135505.850577:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d2ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12015 expref: 23 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.850613:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:2.0:1783135505.850620:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135505.850699:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+22:2363:x1869752792320000:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 177us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135505.850707:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:1.0:1783135505.851369:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792319872 00000100:00100000:1.0:1783135505.851375:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792319872 00000100:00100000:1.0:1783135505.851458:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 147 00000100:00100000:1.0:1783135505.851467:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+22:11343:x1869752792319872:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135505.851492:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135505.851510:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d2f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1201c expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.851635:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d2ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.851651:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d2ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.851662:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d2ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135505.851675:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783135505.852041:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d2f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1201c expref: 25 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.852061:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d2ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1201c expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.852071:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:1.0:1783135505.852074:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783135505.852077:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c200, rc 0) 00000100:00100000:1.0:1783135505.852134:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+24:11343:x1869752792319872:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 669us (3024us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783135505.852153:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 147 00000100:00100000:3.0:1783135505.859332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135505.859430:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792320128 00000100:00100000:1.0:1783135505.859443:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792320128 00000100:00100000:1.0:1783135505.859519:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:1.0:1783135505.859531:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792320128:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:1.0:1783135505.859595:0:8303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.859631:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.859642:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135505.859646:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783135505.859651:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.859696:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 6 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.859712:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 6 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135505.859729:0:8303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c69ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8303:1869752813298944:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135505.859887:0:8303:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02bf6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135505.871619:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135505.871619:0:8303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c69ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8303:1869752813298944:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135505.871673:0:8303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.871996:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792320256 00000100:00100000:2.0:1783135505.872007:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792320256 00002000:00100000:2.0:1783135505.872073:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e8f3db05500 x1869752792320256/t0(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:676/0 lens 504/0 e 0 to 0 dl 1783135516 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135505.872083:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3db05500 with x1869752792320256 ext(0->12) 00010000:00010000:2.0:1783135505.872093:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 7 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.872120:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 7 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135505.872129:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8f3db05500 00000100:00100000:2.0:1783135505.872159:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:2.0:1783135505.872171:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792320256:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:2.0:1783135505.874804:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+9:2361:x1869752792320256:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 2561us (3126us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1783135505.874843:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2 00002000:00100000:2.0:1783135505.874860:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8e8f3db05500 x1869752792320256/t4294967305(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:676/0 lens 504/448 e 0 to 0 dl 1783135516 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135505.874872:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3db05500 with x1869752792320256 ext(0->12) 00010000:00010000:2.0:1783135505.874882:0:6593:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 9 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.874903:0:6593:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 9 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135505.874934:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8f3db05500 00000100:00100000:3.0:1783135505.877302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135505.877689:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792320384 00000100:00100000:0.0:1783135505.877700:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792320384 00010000:00010000:0.0:1783135505.877753:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 9 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135505.877793:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 62 00000100:00100000:0.0:1783135505.877804:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+9:2362:x1869752792320384:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135505.877843:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783135505.877868:0:11521:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783135505.877872:0:11521:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783135505 00002000:00010000:0.0:1783135505.877874:0:11521:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783135505 00002000:00010000:0.0:1783135505.877877:0:11521:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783135505 00010000:00010000:0.0:1783135505.877883:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 9 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.877895:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 9 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.877940:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2f98863/0xf646e0cda875d2c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12000 expref: 9 pid: 6590 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.877958:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135505.877961:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135505.878131:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.878143:0:11521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.878183:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135505.878244:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+8:2362:x1869752792320384:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 441us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135505.878254:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 62 00010000:00010000:1.0:1783135505.878315:0:8303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.878326:0:8303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.878356:0:8303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.878365:0:8303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.878373:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.878380:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135505.878384:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.878394:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.878406:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135505.878437:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000353230d0/0xf646e0cda875d30d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135505.878504:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792320128:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 18976us (19189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135505.878516:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:3.0:1783135505.880390:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135505.880490:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792320640 00000100:00100000:2.0:1783135505.880502:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792320640 00000100:00100000:2.0:1783135505.880563:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:2.0:1783135505.880571:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26324050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+24:11343:x1869752792320640:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:2.0:1783135505.880661:0:5797:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d2ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1201c expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135505.880980:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1783135505.881009:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1783135505.881733:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1783135505.881805:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.881856:0:5797:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 28 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.881868:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.881919:0:5797:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 28 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.881936:0:5797:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 28 pid: 9499 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.881955:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1869752813299072:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135505.882093:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135505.884939:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5797:1869752813299072:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135505.884987:0:5797:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135505.886061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135505.886130:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792320768 00000100:00100000:2.0:1783135505.886139:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792320768 00010000:00010000:2.0:1783135505.886180:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 29 pid: 9499 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.886227:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 63 00000100:00100000:2.0:1783135505.886344:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+29:2360:x1869752792320768:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135505.886362:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135505.886368:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 29 pid: 9499 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.886379:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 29 pid: 9499 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.886402:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d2ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11ff2 expref: 29 pid: 9499 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.886422:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:2.0:1783135505.886428:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.886440:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.886467:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.886494:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135505.886532:0:5797:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.886543:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.886555:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+28:2360:x1869752792320768:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 213us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135505.886693:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 63 00000001:00080000:3.0:1783135505.886732:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1783135505.887042:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1783135505.887205:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c59f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813299200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1783135505.887286:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135505.887321:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3ccaf300 going to sleep for 11 seconds 00000100:00100000:2.0:1783135505.887327:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813299200 00000100:00100000:2.0:1783135505.887333:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813299200 00000100:00100000:2.0:1783135505.887379:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135505.887385:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1869752813299200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783135505.887478:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1869752813299200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 91us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135505.887485:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1783135505.887522:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135505.888509:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c59f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813299200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783135505.889394:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1783135505.889505:0:5797:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fd47480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813299328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783135505.889581:0:5797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135505.889624:0:5797:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0629bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135505.889639:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813299328 00000100:00100000:2.0:1783135505.889647:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813299328 00000100:00100000:2.0:1783135505.889695:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135505.889703:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5797:x1869752813299328:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1783135505.889928:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5797:x1869752813299328:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 225us (347us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783135505.889934:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783135505.890046:0:5797:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fd47480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5797:1869752813299328:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783135505.890121:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1783135505.890164:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.890188:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.890196:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.890202:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135505.890207:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.890216:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.890236:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135505.890240:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783135505.890245:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135505.890251:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d314 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5797 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135505.890681:0:5797:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783135505.890873:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1783135505.890889:0:5797:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 405320072595ns, next at 406320069764ns, rc = 0 00000001:00080000:0.0:1783135505.890897:0:5797:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1783135505.890936:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135505.890940:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783135505.890949:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d2ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1201c expref: 32 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135505.891182:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26324050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+31:11343:x1869752792320640:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 10609us (10802us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1783135505.891193:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 38 00000020:00080000:0.0:1783135505.891199:0:5797:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783135505.895204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135505.895370:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792320896 00000100:00100000:2.0:1783135505.895385:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792320896 00000100:00100000:2.0:1783135505.895538:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 148 00000100:00100000:2.0:1783135505.895552:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+31:11343:x1869752792320896:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135505.895586:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135505.895645:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d31b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12023 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.895733:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d31b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12023 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.895751:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d31b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12023 expref: 32 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.895775:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135505.895779:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135505.895783:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3200, rc 0) 00000100:00100000:2.0:1783135505.895898:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+32:11343:x1869752792320896:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 349us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135505.895907:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 148 00000100:00100000:3.0:1783135505.899724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135505.899791:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792321152 00000100:00100000:1.0:1783135505.899803:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792321152 00000100:00100000:1.0:1783135505.899883:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:1.0:1783135505.899893:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+32:11343:x1869752792321152:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1783135505.900225:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+33:11343:x1869752792321152:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 332us (516us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1783135505.900233:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:0.0:1783135505.953182:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135505.953804:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792321408 00000100:00100000:3.0:1783135505.953881:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792321408 00000100:00100000:3.0:1783135505.953961:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 149 00000100:00100000:3.0:1783135505.953974:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+33:11354:x1869752792321408:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135505.954007:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135505.954033:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1202a expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135505.954317:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783135505.954745:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d322 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1202a expref: 35 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.954764:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:3.0:1783135505.954767:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135505.954774:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1202a expref: 35 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135505.954792:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487800, rc 0) 00000100:00100000:3.0:1783135505.954997:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+34:11354:x1869752792321408:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1025us (1831us total) trans 4294967433 rc 301/301 00000100:00100000:3.0:1783135505.955006:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 149 00000100:00100000:3.0:1783135505.963110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135505.964083:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792321536 00000100:00100000:2.0:1783135505.964109:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792321536 00000100:00100000:2.0:1783135505.964206:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 150 00000100:00100000:2.0:1783135505.964218:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+34:11354:x1869752792321536:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:2.0:1783135505.964336:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964360:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964376:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964425:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964439:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964446:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964613:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964622:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964630:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135505.964687:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964704:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964711:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964720:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964728:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135505.964733:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964743:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964768:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:2.0:1783135505.964772:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135505.964778:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964786:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3e00/0xf646e0cda875d330 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964806:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964890:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964898:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964904:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135505.964907:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964915:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964924:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f18315f00) 00010000:00010000:2.0:1783135505.964927:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135505.964931:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964937:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d337 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964969:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964976:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964982:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964987:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135505.964991:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.964998:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.965006:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135505.965009:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135505.965012:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135505.965018:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d33e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135505.965130:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+34:11354:x1869752792321536:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 911us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135505.965140:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 150 00000100:00100000:0.0:1783135505.972730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135505.972808:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792321792 00000100:00100000:3.0:1783135505.972854:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792321792 00000100:00100000:3.0:1783135505.972937:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 40 00000100:00100000:3.0:1783135505.972949:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+34:11354:x1869752792321792:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1783135505.973792:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+35:11354:x1869752792321792:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 839us (1075us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1783135505.973848:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 40 00000100:00100000:0.0:1783135506.022904:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135506.023073:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792322048 00000100:00100000:1.0:1783135506.023086:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792322048 00000100:00100000:1.0:1783135506.023186:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 151 00000100:00100000:1.0:1783135506.023207:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+35:11357:x1869752792322048:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135506.023241:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135506.023270:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875d345 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12031 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.023374:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.023670:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.023684:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.023701:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.023708:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.023713:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.023989:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.023998:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024005:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135506.024015:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783135506.024608:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024619:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024627:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024645:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121dc00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135506.024650:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024658:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024674:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135506.024677:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135506.024682:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024689:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d34c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024707:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024713:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024719:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024724:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121ca00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135506.024727:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.024733:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.025509:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f10923700) 00010000:00010000:1.0:1783135506.025513:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135506.025517:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.025524:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d353 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.025605:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875d345 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 38 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.025621:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 37 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.025629:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:1.0:1783135506.025632:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135506.025635:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d200, rc 0) 00000100:00100000:1.0:1783135506.025734:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+37:11357:x1869752792322048:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2535us (2845us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1783135506.026428:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 151 00000100:00100000:0.0:1783135506.038349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135506.038649:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792322176 00000100:00100000:2.0:1783135506.038664:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792322176 00000100:00100000:2.0:1783135506.038785:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 152 00000100:00100000:2.0:1783135506.038851:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+37:11357:x1869752792322176:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:2.0:1783135506.041410:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041443:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041459:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041498:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041505:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041512:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041519:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135506.041524:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041532:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041545:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135506.041548:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135506.041554:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.041711:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d368 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135506.042520:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+37:11357:x1869752792322176:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 3698us (4184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135506.042533:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 152 00000100:00100000:3.0:1783135506.043071:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813299456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135506.043157:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135506.043201:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813299456 00000100:00100000:0.0:1783135506.043212:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813299456 00000100:00100000:0.0:1783135506.043277:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783135506.043288:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813299456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135506.043315:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135506.043361:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10533480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813299456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.043368:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135506.044132:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813299456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135506.045479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135506.045654:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792322432 00000100:00100000:1.0:1783135506.045665:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792322432 00000100:00100000:1.0:1783135506.045730:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:1.0:1783135506.045741:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+37:11357:x1869752792322432:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1783135506.047247:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+38:11357:x1869752792322432:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 1495us (1766us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1783135506.047264:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:0.0:1783135506.249946:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135506.250286:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792322688 00000100:00100000:3.0:1783135506.250370:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792322688 00000100:00100000:2.0:1783135506.250916:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 153 00000100:00100000:2.0:1783135506.250927:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+38:11388:x1869752792322688:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:2.0:1783135506.250958:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135506.250983:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d36f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12038 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.251132:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d376 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.251153:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.251168:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d376 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135506.251184:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783135506.251358:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d36f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12038 expref: 41 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.251385:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d376 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12038 expref: 40 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.251395:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135506.251398:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135506.251419:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c39600, rc 0) 00000100:00100000:2.0:1783135506.251723:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+40:11388:x1869752792322688:12345-192.168.201.60@tcp:101:cat.0 Request processed in 795us (1794us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1783135506.251731:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 153 00000100:00100000:0.0:1783135506.255674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135506.255767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135506.255904:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792322816 00000100:00100000:3.0:1783135506.255917:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792322816 00000100:00100000:3.0:1783135506.255999:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:3.0:1783135506.256011:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+40:2362:x1869752792322816:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135506.256030:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135506.256063:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d376 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12038 expref: 40 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.256087:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:3.0:1783135506.256104:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135506.256222:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+39:2362:x1869752792322816:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 212us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135506.256230:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:2.0:1783135506.256542:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792323072 00000100:00100000:2.0:1783135506.256549:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792323072 00000100:00100000:2.0:1783135506.256711:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:2.0:1783135506.256722:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+39:11388:x1869752792323072:12345-192.168.201.60@tcp:35:cat.0 00000100:00100000:2.0:1783135506.257036:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+40:11388:x1869752792323072:12345-192.168.201.60@tcp:35:cat.0 Request processed in 315us (1267us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1783135506.257044:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:0.0:1783135506.330130:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135506.330330:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792323328 00000100:00100000:1.0:1783135506.330342:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792323328 00000100:00100000:1.0:1783135506.330427:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 154 00000100:00100000:1.0:1783135506.330440:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+40:11394:x1869752792323328:12345-192.168.201.60@tcp:101:dd.0 00010000:00010000:1.0:1783135506.330473:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135506.330477:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783135506.330524:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d2dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1200e expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.330552:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135506.330559:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135506.330575:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875d384 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1203f expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.330946:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.330964:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.330974:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.331015:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 40 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.331030:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 40 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135506.331070:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c69ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813299584:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135506.331708:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02bf6d80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135506.335885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135506.336167:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c69ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813299584:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135506.336206:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135506.338068:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792323456 00000100:00100000:2.0:1783135506.338085:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792323456 00010000:00010000:2.0:1783135506.338160:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 41 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135506.338675:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00100000:2.0:1783135506.338689:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+41:2360:x1869752792323456:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135506.338711:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135506.338721:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 41 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.338735:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 41 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.338763:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d200/0xf646e0cda875d35a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12031 expref: 41 pid: 5795 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.338807:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135506.338861:0:11521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.338874:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.338882:0:11521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.338927:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135506.339013:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02ce2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+40:2360:x1869752792323456:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 327us (3142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135506.339022:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 64 00010000:00010000:0.0:1783135506.339551:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.339563:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135506.339601:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1783135506.339858:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d600/0xf646e0cda875d384 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 41 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.339882:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.339891:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:0.0:1783135506.339895:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135506.339897:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121ca00, rc 0) 00000100:00100000:0.0:1783135506.339944:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+40:11394:x1869752792323328:12345-192.168.201.60@tcp:101:dd.0 Request processed in 9507us (9828us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1783135506.339953:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 154 00000100:00100000:0.0:1783135506.345018:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135506.345133:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792323712 00000100:00100000:1.0:1783135506.345146:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792323712 00000100:00100000:1.0:1783135506.345228:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 155 00000100:00100000:1.0:1783135506.345241:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+40:11394:x1869752792323712:12345-192.168.201.60@tcp:36:dd.0 00010000:00010000:1.0:1783135506.345862:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.345886:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.345901:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135506.345965:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1783135506.345990:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000df41ff27 reply state 00000000f0a8a193 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135506.346000:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135506.346181:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+43:11394:x1869752792323712:12345-192.168.201.60@tcp:36:dd.0 Request processed in 940us (1175us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1783135506.346197:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 155 00000020:00080000:1.0:1783135506.346222:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783135506.364250:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135506.365019:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.365037:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.365046:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.365053:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135506.365060:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.365099:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.365123:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:0.0:1783135506.365127:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135506.365132:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.365139:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d399 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135506.482964:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135506.484414:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792323840 00000100:00100000:2.0:1783135506.484433:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792323840 00000100:00100000:2.0:1783135506.484535:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 156 00000100:00100000:2.0:1783135506.484548:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+42:11408:x1869752792323840:12345-192.168.201.60@tcp:101:stat.0 00010000:00010000:2.0:1783135506.484583:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135506.484610:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d3a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12046 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.484702:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.484721:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.484734:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.484771:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.484779:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135506.484786:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.487693:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.487724:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.487735:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.487910:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.487931:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 43 pid: 5796 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135506.487953:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813299712:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135506.488191:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3ccaf540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135506.496328:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135506.496966:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792324096 00000100:00100000:1.0:1783135506.496980:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792324096 00000100:00100000:1.0:1783135506.497055:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:1.0:1783135506.497067:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+44:5575:x1869752792324096:12345-192.168.201.60@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783135506.497549:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+45:5575:x1869752792324096:12345-192.168.201.60@tcp:35:ldlm_bl.0 Request processed in 481us (1235us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1783135506.497559:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:3.0:1783135506.499482:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813299712:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135506.499524:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135506.500858:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135506.500964:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792324224 00000100:00100000:3.0:1783135506.500974:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792324224 00010000:00010000:3.0:1783135506.501020:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 45 pid: 5796 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135506.501121:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 65 00000100:00100000:3.0:1783135506.501133:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+45:2360:x1869752792324224:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135506.501152:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135506.501161:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 45 pid: 5796 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.501174:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 45 pid: 5796 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.501242:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d38b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1203f expref: 45 pid: 5796 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.501265:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:3.0:1783135506.501271:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.501282:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.501290:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.501329:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135506.501411:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+44:2360:x1869752792324224:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 279us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135506.501421:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 65 00010000:00010000:1.0:1783135506.501490:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501499:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135506.501565:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783135506.501571:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135506.501608:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501625:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501639:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501647:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501654:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501661:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135506.501676:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501685:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501697:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135506.501701:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135506.501704:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501711:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d3a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501725:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501732:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.501738:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.502904:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135506.502912:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.502922:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.502937:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f18315f00) 00010000:00010000:1.0:1783135506.502941:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135506.502961:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.502969:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d3ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.503040:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d3a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12046 expref: 44 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.503057:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12046 expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.503065:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:1.0:1783135506.503067:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135506.503070:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487800, rc 0) 00000100:00100000:1.0:1783135506.503164:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+43:11408:x1869752792323840:12345-192.168.201.60@tcp:101:stat.0 Request processed in 18618us (20212us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135506.503175:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 156 00000100:00100000:2.0:1783135506.616236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135506.616542:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792324480 00000100:00100000:0.0:1783135506.616557:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792324480 00000100:00100000:0.0:1783135506.616642:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 157 00000100:00100000:0.0:1783135506.616655:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+43:11414:x1869752792324480:12345-192.168.201.60@tcp:36:truncate.0 00010000:00010000:0.0:1783135506.616751:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135506.616789:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d3b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12046 expref: 43 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.616871:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:0.0:1783135506.616877:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135506.627528:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.627562:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135506.627581:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135506.628361:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1783135506.628980:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd9d6143 reply state 000000007190b439 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135506.629020:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135506.629948:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+45:11414:x1869752792324480:12345-192.168.201.60@tcp:36:truncate.0 Request processed in 13287us (13727us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1783135506.629960:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 157 00000020:00080000:1.0:1783135506.629968:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135506.649112:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.649136:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.649146:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.649153:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135506.649159:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.649218:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.649244:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:3.0:1783135506.649248:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135506.649254:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135506.649262:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d3bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135506.809200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135506.809994:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792324608 00000100:00100000:0.0:1783135506.810008:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792324608 00000100:00100000:0.0:1783135506.810104:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 158 00000100:00100000:0.0:1783135506.810116:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+44:11428:x1869752792324608:12345-192.168.201.60@tcp:101:stat.0 00010000:00010000:0.0:1783135506.810149:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135506.810201:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d3c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1204d expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810291:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810309:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810321:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810337:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810343:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810349:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810483:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810491:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810498:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135506.810543:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1783135506.810548:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135506.810576:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810596:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810606:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810613:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810621:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810627:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135506.810632:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810640:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810654:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135506.810657:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135506.810661:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810667:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810681:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810687:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810698:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810703:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135506.810706:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810711:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810717:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135506.810719:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135506.810722:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810727:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d3d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810768:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d3c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 46 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810782:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 45 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.810789:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:0.0:1783135506.810791:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135506.810793:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043600, rc 0) 00000100:00100000:0.0:1783135506.810933:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+45:11428:x1869752792324608:12345-192.168.201.60@tcp:101:stat.0 Request processed in 819us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135506.810949:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 158 00000100:00100000:1.0:1783135506.907274:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135506.907400:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792324864 00000100:00100000:0.0:1783135506.907413:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792324864 00000100:00100000:0.0:1783135506.907481:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 159 00000100:00100000:0.0:1783135506.907491:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+45:11438:x1869752792324864:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135506.907515:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135506.907538:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d3df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12054 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135506.907699:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783135506.907860:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d3df lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12054 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.907875:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:0.0:1783135506.907877:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135506.907881:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d3df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12054 expref: 47 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135506.907895:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043200, rc 0) 00000100:00100000:0.0:1783135506.907968:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c69ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+46:11438:x1869752792324864:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 477us (710us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1783135506.907976:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 159 00000100:00100000:3.0:1783135506.911907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135506.912110:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792325120 00000100:00100000:1.0:1783135506.912124:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792325120 00000100:00100000:1.0:1783135506.912984:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:1.0:1783135506.913005:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26327850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+46:11438:x1869752792325120:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1783135506.913528:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26327850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+47:11438:x1869752792325120:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 527us (1632us total) trans 4294967446 rc 0/0 00000100:00100000:1.0:1783135506.913541:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:2.0:1783135507.001583:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.002091:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792325376 00000100:00100000:0.0:1783135507.002107:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792325376 00000100:00100000:0.0:1783135507.002441:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 160 00000100:00100000:0.0:1783135507.002454:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+47:11445:x1869752792325376:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135507.002506:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135507.002534:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d3ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1205b expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.002705:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.002723:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.002742:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.002786:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.002801:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 48 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135507.002843:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fd47800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813299840:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135507.002976:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0629b9c0 going to sleep for 11 seconds 00000100:00080000:1.0:1783135507.004876:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135507.008913:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135507.009168:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792325504 00000100:00100000:2.0:1783135507.009182:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792325504 00010000:00010000:2.0:1783135507.009245:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 49 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135507.009300:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 66 00000100:00100000:2.0:1783135507.009313:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+49:2361:x1869752792325504:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135507.009332:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135507.009340:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 49 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.009356:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 49 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.009414:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135507.009421:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.009432:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.009440:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.009463:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135507.009548:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+49:2361:x1869752792325504:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 236us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135507.009558:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 66 00010000:00010000:1.0:1783135507.010961:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875d3d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1204d expref: 48 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135507.010992:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fd47800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813299840:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135507.011033:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.011044:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.011051:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135507.011109:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1783135507.011553:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d3ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 49 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.011574:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.011585:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:1.0:1783135507.011588:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135507.011592:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042e00, rc 0) 00000100:00100000:1.0:1783135507.012138:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+48:11445:x1869752792325376:12345-192.168.201.60@tcp:101:bash.0 Request processed in 9684us (10569us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1783135507.012149:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 160 00000100:00100000:0.0:1783135507.033116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135507.035923:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792325760 00000100:00100000:1.0:1783135507.035947:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792325760 00000100:00100000:1.0:1783135507.036063:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 161 00000100:00100000:1.0:1783135507.036088:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+48:11445:x1869752792325760:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:1.0:1783135507.036494:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.036518:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.036533:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135507.036598:0:5795:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1783135507.036652:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f73c2d38 reply state 000000007893e97b transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135507.036663:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135507.037145:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+51:11445:x1869752792325760:12345-192.168.201.60@tcp:36:bash.0 Request processed in 740us (3714us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1783135507.037155:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 161 00000020:00080000:1.0:1783135507.037164:0:5795:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783135507.039891:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.039915:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.039923:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.039930:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135507.039935:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.039943:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.039965:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:1.0:1783135507.039968:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135507.039973:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.039981:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d402 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135507.046669:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135507.047679:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792325888 00000100:00100000:3.0:1783135507.047694:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792325888 00000100:00100000:3.0:1783135507.047781:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 162 00000100:00100000:3.0:1783135507.047793:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+50:11445:x1869752792325888:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1783135507.047867:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135507.047898:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d409 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12062 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135507.048026:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135507.048045:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135507.048054:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135507.048129:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 51 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135507.048145:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 51 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135507.048162:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813299968:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135507.048905:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3ccaf540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135507.056403:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135507.056868:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813299968:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135507.056926:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135507.057183:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792326016 00000100:00100000:2.0:1783135507.057193:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792326016 00010000:00010000:2.0:1783135507.057411:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 52 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135507.057458:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 67 00000100:00100000:2.0:1783135507.057469:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+52:2360:x1869752792326016:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135507.057492:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135507.057501:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 52 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.057515:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 52 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.057799:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d3f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1205b expref: 52 pid: 5796 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.057848:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135507.057855:0:6604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.057868:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.057878:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.057913:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135507.057989:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+51:2360:x1869752792326016:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 521us (1615us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135507.057999:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 67 00010000:00010000:1.0:1783135507.059963:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.059988:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135507.060071:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783135507.060088:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135507.060118:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.060185:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d409 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12062 expref: 51 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.061437:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12062 expref: 50 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.061455:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:1.0:1783135507.061458:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135507.061463:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487c00, rc 0) 00000100:00100000:1.0:1783135507.061573:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+50:11445:x1869752792325888:12345-192.168.201.60@tcp:101:bash.0 Request processed in 13780us (14919us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135507.061583:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 162 00000100:00100000:2.0:1783135507.072512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.072748:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792326272 00000100:00100000:0.0:1783135507.072763:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792326272 00000100:00100000:0.0:1783135507.072872:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:0.0:1783135507.072885:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+50:11445:x1869752792326272:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1783135507.073283:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+51:11445:x1869752792326272:12345-192.168.201.60@tcp:35:bash.0 Request processed in 399us (832us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1783135507.073293:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 45 00000040:00080000:1.0:1783135507.259744:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135507.259758:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135507.260022:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1783135507.260028:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135507.294510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135507.294641:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792326528 00000100:00100000:1.0:1783135507.294655:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792326528 00000100:00100000:1.0:1783135507.294742:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 163 00000100:00100000:1.0:1783135507.294755:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+51:11455:x1869752792326528:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135507.294790:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135507.294874:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d417 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12069 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135507.295059:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783135507.295243:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d417 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12069 expref: 53 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.295261:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:1.0:1783135507.295265:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135507.295271:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d417 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12069 expref: 53 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.295288:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d000, rc 0) 00000100:00100000:1.0:1783135507.295370:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+52:11455:x1869752792326528:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 617us (877us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1783135507.295379:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 163 00000100:00100000:3.0:1783135507.300481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135507.300606:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792326656 00000100:00100000:1.0:1783135507.300634:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792326656 00000100:00100000:1.0:1783135507.300718:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 164 00000100:00100000:1.0:1783135507.300730:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+52:11455:x1869752792326656:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:1.0:1783135507.300898:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.300945:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.300960:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.300978:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.300986:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.300993:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301142:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301149:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301154:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135507.301221:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301237:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301245:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301264:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301289:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135507.301296:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301306:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301319:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135507.301321:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135507.301325:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301330:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d425 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301343:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301346:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301350:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301354:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121da00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135507.301356:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301367:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301373:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f10923700) 00010000:00010000:1.0:1783135507.301375:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135507.301377:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301383:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d42c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301400:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301406:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301412:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301418:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135507.301421:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301427:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301433:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:1.0:1783135507.301434:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135507.301436:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.301447:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d433 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135507.301529:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+52:11455:x1869752792326656:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 800us (1062us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135507.301710:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 164 00000100:00100000:2.0:1783135507.309509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.309621:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792326912 00000100:00100000:0.0:1783135507.309634:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792326912 00000100:00100000:0.0:1783135507.309710:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:0.0:1783135507.309723:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+52:11455:x1869752792326912:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135507.310127:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+53:11455:x1869752792326912:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 405us (634us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1783135507.310136:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:2.0:1783135507.377083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135507.377282:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792327168 00000100:00100000:1.0:1783135507.377296:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792327168 00000100:00100000:1.0:1783135507.377440:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 165 00000100:00100000:1.0:1783135507.377450:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+53:11458:x1869752792327168:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135507.377479:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135507.377502:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d43a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12070 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377632:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377650:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377664:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377677:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377682:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377696:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377915:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d44f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377922:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d44f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.377927:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d44f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135507.377936:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1783135507.378038:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378044:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378050:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378054:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121da00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135507.378058:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378064:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378086:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135507.378089:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135507.378098:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378103:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d441 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378116:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378119:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378123:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378127:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135507.378128:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378131:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378135:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f10923700) 00010000:00010000:1.0:1783135507.378137:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135507.378138:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378141:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d448 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378184:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d43a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12070 expref: 56 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378520:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d44f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12070 expref: 55 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.378526:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:1.0:1783135507.378528:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135507.378530:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d000, rc 0) 00000100:00100000:1.0:1783135507.378667:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+55:11458:x1869752792327168:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1218us (1609us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1783135507.378675:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 165 00000100:00100000:3.0:1783135507.381637:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135507.381695:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135507.383483:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792327296 00000100:00100000:2.0:1783135507.383498:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792327296 00000100:00100000:2.0:1783135507.383596:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:2.0:1783135507.383611:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+55:2363:x1869752792327296:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135507.383634:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135507.383670:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d44f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12070 expref: 55 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.383711:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135507.383715:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135507.383898:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792327424 00000100:00100000:1.0:1783135507.383902:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792327424 00000100:00100000:1.0:1783135507.383937:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 166 00000100:00100000:1.0:1783135507.383943:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+55:11458:x1869752792327424:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:1.0:1783135507.384009:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384023:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384032:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384061:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384067:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384095:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384099:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135507.384104:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384109:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384115:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:1.0:1783135507.384118:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135507.384120:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.384125:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d45d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135507.384218:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+55:2363:x1869752792327296:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 610us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135507.384226:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 12 00010000:00010000:2.0:1783135507.386649:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135507.387480:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+54:11458:x1869752792327424:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 3525us (5772us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135507.387495:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 166 00000100:00100000:2.0:1783135507.391750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.392299:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792327680 00000100:00100000:0.0:1783135507.392314:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792327680 00000100:00100000:0.0:1783135507.399693:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:0.0:1783135507.399709:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+54:11458:x1869752792327680:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135507.400274:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+55:11458:x1869752792327680:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 566us (8548us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1783135507.400284:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:0.0:1783135507.451658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.451713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.451755:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.451798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.451870:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792328192 00000100:00100000:0.0:1783135507.451882:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792328192 00000100:00080000:0.0:1783135507.451922:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135507.451977:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 157 00000100:00100000:0.0:1783135507.451990:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792328192:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135507.452137:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2361:x1869752792328192:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 148us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135507.452147:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 157 00000100:00100000:3.0:1783135507.452300:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792327808 00000100:00100000:3.0:1783135507.452305:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792327808 00000100:00100000:3.0:1783135507.452346:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 295 00000100:00100000:3.0:1783135507.452354:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792327808:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135507.452395:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792327808:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 42us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135507.452402:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 295 00000100:00100000:1.0:1783135507.452603:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792328064 00000100:00100000:1.0:1783135507.452609:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792328064 00000100:00100000:2.0:1783135507.453132:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792327936 00000100:00100000:2.0:1783135507.453149:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792327936 00000100:00100000:2.0:1783135507.453270:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 87 00000100:00100000:2.0:1783135507.453286:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792327936:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135507.453385:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792327936:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 105us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135507.453394:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 87 00000100:00080000:3.0:1783135507.454885:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135507.454898:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135507.463673:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 88 00000100:00100000:1.0:1783135507.463695:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792328064:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135507.466512:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792328064:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 2813us (14785us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135507.466527:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 88 00000100:00100000:0.0:1783135507.549943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135507.550075:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792328448 00000100:00100000:2.0:1783135507.550089:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792328448 00000100:00100000:2.0:1783135507.550172:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 167 00000100:00100000:2.0:1783135507.550186:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+55:11476:x1869752792328448:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:2.0:1783135507.550223:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135507.550252:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d464 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12077 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.550404:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d46b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.550422:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d46b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.550456:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d46b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135507.550473:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783135507.550684:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d464 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12077 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.550707:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d46b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12077 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135507.550718:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:2.0:1783135507.550721:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783135507.550725:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c39400, rc 0) 00000100:00100000:2.0:1783135507.550900:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+57:11476:x1869752792328448:12345-192.168.201.60@tcp:101:cat.0 Request processed in 716us (970us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1783135507.550909:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 167 00000100:00100000:3.0:1783135507.577318:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.577875:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792328576 00000100:00100000:0.0:1783135507.577890:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792328576 00000100:00100000:0.0:1783135507.577967:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 168 00000100:00100000:0.0:1783135507.577980:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+57:11477:x1869752792328576:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135507.578024:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135507.578053:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d479 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1207e expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.578192:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d480 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.578212:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.578227:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135507.578309:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1783135507.578313:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135507.578341:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d480 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.578701:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d479 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1207e expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.578739:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d480 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1207e expref: 58 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.578749:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135507.578753:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135507.578758:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042c00, rc 0) 00000100:00100000:0.0:1783135507.578897:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+58:11477:x1869752792328576:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 918us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135507.578906:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 168 00000100:00100000:0.0:1783135507.585610:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135507.586194:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792328960 00000100:00100000:1.0:1783135507.586209:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792328960 00000100:00100000:1.0:1783135507.586297:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:1.0:1783135507.586322:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+58:11477:x1869752792328960:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1783135507.586966:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+59:11477:x1869752792328960:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 657us (1379us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1783135507.586975:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:1.0:1783135507.595662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.595909:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792329088 00000100:00100000:0.0:1783135507.595919:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792329088 00000100:00100000:0.0:1783135507.595983:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:0.0:1783135507.595993:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+59:11477:x1869752792329088:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:0.0:1783135507.596009:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783135507.596035:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d410 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12062 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.596056:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d46b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12077 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.596081:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3200/0xf646e0cda875d31b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12023 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.596093:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315200) 00010000:00010000:0.0:1783135507.596116:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135507.596184:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+56:11477:x1869752792329088:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 191us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135507.596192:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:0.0:1783135507.599931:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135507.601130:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792329216 00000100:00100000:1.0:1783135507.601144:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792329216 00000100:00100000:1.0:1783135507.601204:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 169 00000100:00100000:1.0:1783135507.601214:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+56:11477:x1869752792329216:12345-192.168.201.60@tcp:58:lfs.0 00010000:00010000:1.0:1783135507.601360:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.601618:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135507.601633:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135507.601861:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1783135507.601962:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+56:11477:x1869752792329216:12345-192.168.201.60@tcp:58:lfs.0 Request processed in 746us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135507.601970:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 169 00000100:00100000:2.0:1783135507.652020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135507.652756:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792329344 00000100:00100000:0.0:1783135507.652766:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792329344 00000100:00100000:0.0:1783135507.652872:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 170 00000100:00100000:0.0:1783135507.652883:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+56:11479:x1869752792329344:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135507.652907:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135507.652931:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d48e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12085 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.652998:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653013:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653024:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653039:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653046:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653052:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653187:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653196:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653214:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135507.653252:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1783135507.653256:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135507.653273:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653284:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653292:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653299:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653306:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653323:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135507.653328:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653335:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653355:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135507.653358:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135507.653363:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653370:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d495 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653560:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653567:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653572:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653577:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135507.653580:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653585:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653592:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135507.653594:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135507.653597:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653602:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d49c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653643:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d48e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 58 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653654:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 57 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135507.653661:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135507.653663:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135507.653665:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042000, rc 0) 00000100:00100000:0.0:1783135507.653732:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+57:11479:x1869752792329344:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 851us (1722us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135507.653740:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 170 00000100:00100000:3.0:1783135508.090164:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135508.090976:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813300096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135508.091072:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135508.091269:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813300096 00000100:00100000:0.0:1783135508.091277:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813300096 00000100:00100000:0.0:1783135508.091367:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783135508.091387:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813300096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135508.091426:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135508.091490:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813300096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (418us total) trans 0 rc 0/0 00000100:00080000:2.0:1783135508.091495:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135508.091497:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783135508.091575:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813300096:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1783135508.285441:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783135508.285463:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135508.285526:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783135508.285539:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135508.285810:0:11538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813300224:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783135508.285951:0:11538:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f394dd540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135508.289303:0:11538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb7800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813300224:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135508.290449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135508.296696:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792329472 00000100:00100000:1.0:1783135508.296713:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792329472 00000100:00100000:0.0:1783135508.296958:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 171 00000100:00100000:0.0:1783135508.296970:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+57:11490:x1869752792329472:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135508.297004:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135508.297140:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+57:11490:x1869752792329472:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 171us (6696us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135508.297166:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 171 00000100:00100000:2.0:1783135508.305697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135508.305809:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792329600 00000100:00100000:0.0:1783135508.306012:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792329600 00000100:00100000:2.0:1783135508.306176:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 172 00000100:00100000:2.0:1783135508.306188:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+57:11490:x1869752792329600:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783135508.306264:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306283:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306295:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306329:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306337:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306345:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306373:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306382:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306389:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135508.306428:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783135508.306432:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135508.306443:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306468:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306475:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306481:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306496:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135508.306500:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306508:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306520:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:2.0:1783135508.306523:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135508.306528:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306534:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d4aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306548:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306554:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306560:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306565:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135508.306569:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306588:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306608:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8e8f18315a00) 00010000:00010000:2.0:1783135508.306610:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135508.306613:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306618:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d4b1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306634:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306640:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306645:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306650:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135508.306653:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306659:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306667:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:2.0:1783135508.306669:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135508.306672:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.306677:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d4b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.306767:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+57:11490:x1869752792329600:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 Request processed in 581us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135508.306775:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 172 00000100:00100000:3.0:1783135508.315760:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135508.315953:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792329856 00000100:00100000:0.0:1783135508.315963:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792329856 00000100:00100000:0.0:1783135508.316019:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 173 00000100:00100000:0.0:1783135508.316027:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+57:11490:x1869752792329856:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135508.316047:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135508.316077:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d4bf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1208c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316178:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316194:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316206:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135508.316217:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1783135508.316316:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316324:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316331:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316353:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135508.316357:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316365:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316378:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135508.316381:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135508.316384:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316390:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042e00/0xf646e0cda875d4c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316432:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d4bf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1208c expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316443:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:0.0:1783135508.316445:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135508.316448:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875d4bf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1208c expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.316567:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043000, rc 0) 00000100:00100000:0.0:1783135508.316705:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+58:11490:x1869752792329856:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 678us (956us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1783135508.316712:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 173 00000100:00100000:0.0:1783135508.326744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135508.326871:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792329984 00000100:00100000:2.0:1783135508.326882:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792329984 00000100:00100000:2.0:1783135508.326934:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 174 00000100:00100000:2.0:1783135508.326943:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+58:11490:x1869752792329984:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135508.326982:0:9499:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135508.327111:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+58:11490:x1869752792329984:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 168us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135508.327118:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 174 00000100:00100000:3.0:1783135508.332485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135508.332668:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792330240 00000100:00100000:0.0:1783135508.332679:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792330240 00000100:00100000:0.0:1783135508.332739:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 175 00000100:00100000:0.0:1783135508.332749:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+58:11490:x1869752792330240:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135508.332771:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135508.332775:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1783135508.332803:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d480 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1207e expref: 58 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.332872:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135508.332878:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135508.332892:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d4d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12093 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135508.333333:0:5794:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:0.0:1783135508.333556:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d4db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.333847:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d4db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.333861:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d4db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.333922:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d4d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12093 expref: 60 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.333941:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d4db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12093 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.333970:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135508.333973:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135508.333976:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043200, rc 0) 00000100:00100000:0.0:1783135508.334103:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+59:11490:x1869752792330240:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 1355us (1629us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1783135508.334111:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 175 00000100:00100000:2.0:1783135508.345192:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.352486:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792330496 00000100:00100000:3.0:1783135508.352501:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792330496 00000100:00100000:3.0:1783135508.352566:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 176 00000100:00100000:3.0:1783135508.352584:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+59:11490:x1869752792330496:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783135508.352641:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135508.352667:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d4db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12093 expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352687:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:3.0:1783135508.352697:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135508.352719:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352734:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352743:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352757:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352764:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352771:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352895:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352903:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352910:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352916:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135508.352920:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352928:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352936:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:3.0:1783135508.352939:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135508.352942:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352949:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d4e9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352958:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352964:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352971:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352981:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135508.352984:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352990:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.352997:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x14754051 (ffff8e8f08840300) 00010000:00010000:3.0:1783135508.352999:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135508.353002:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.353008:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d4f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x14754051 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135508.353101:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+58:11490:x1869752792330496:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 518us (7918us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783135508.353109:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 176 00000100:00100000:0.0:1783135508.359863:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135508.360096:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792330624 00000100:00100000:1.0:1783135508.360106:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792330624 00000100:00100000:1.0:1783135508.360160:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 177 00000100:00100000:1.0:1783135508.360169:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+58:11490:x1869752792330624:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135508.360189:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135508.360211:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d4f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1209a expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.360249:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.360261:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.360286:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.360404:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d4f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.360423:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 59 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.360446:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:1.0:1783135508.360449:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135508.360738:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121de00, rc 0) 00000100:00100000:1.0:1783135508.360810:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+59:11490:x1869752792330624:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 641us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.360841:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 177 00000100:00100000:0.0:1783135508.373345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135508.383723:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792330880 00000100:00100000:2.0:1783135508.383739:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792330880 00000100:00100000:2.0:1783135508.383912:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 178 00000100:00100000:2.0:1783135508.383924:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+59:11490:x1869752792330880:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135508.384018:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.384035:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.384047:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135508.384384:0:9499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1783135508.384399:0:9499:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407813582267ns, next at 408813579553ns, rc = 0 00000004:00010000:2.0:1783135508.384528:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bb85c551 reply state 00000000567cb622 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.384539:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135508.387559:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+61:11490:x1869752792330880:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 3625us (14212us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1783135508.387582:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 178 00010000:00010000:0.0:1783135508.397679:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.397700:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.397709:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.397717:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135508.397725:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.397734:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135508.397742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:0.0:1783135508.397769:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:0.0:1783135508.397774:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135508.397779:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.397803:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d505 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.397872:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792331008 00000100:00100000:2.0:1783135508.397883:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792331008 00000100:00100000:2.0:1783135508.397940:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 179 00000100:00100000:2.0:1783135508.397962:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+60:11490:x1869752792331008:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135508.397987:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135508.398007:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120a1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.398084:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.398097:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.398117:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:2.0:1783135508.398120:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135508.398123:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38400, rc 0) 00000100:00100000:2.0:1783135508.398191:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+61:11490:x1869752792331008:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 232us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135508.398198:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 179 00000100:00100000:3.0:1783135508.406622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135508.406926:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792331136 00000100:00100000:2.0:1783135508.406949:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792331136 00000100:00100000:2.0:1783135508.407011:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 50 00000100:00100000:2.0:1783135508.407022:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792331136:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1783135508.409032:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792331136:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 2001us (2409us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1783135508.409046:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 50 00010000:00010000:3.0:1783135508.411788:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135508.423703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.424508:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792331392 00000100:00100000:3.0:1783135508.424520:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792331392 00000100:00100000:3.0:1783135508.424580:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:3.0:1783135508.424592:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+61:11490:x1869752792331392:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783135508.424872:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+62:11490:x1869752792331392:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 281us (1180us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1783135508.424890:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:3.0:1783135508.430476:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135508.431921:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792331648 00000100:00100000:0.0:1783135508.431936:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792331648 00000100:00100000:0.0:1783135508.431997:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 180 00000100:00100000:0.0:1783135508.432008:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+62:11490:x1869752792331648:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783135508.432143:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c375880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+62:11490:x1869752792331648:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 136us (1677us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135508.432151:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 180 00000100:00100000:3.0:1783135508.442235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.442273:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792331776 00000100:00100000:3.0:1783135508.442282:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792331776 00000100:00100000:3.0:1783135508.442336:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 181 00000100:00100000:3.0:1783135508.442346:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+62:11490:x1869752792331776:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135508.442368:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135508.442509:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d513 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120a8 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.442592:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d51a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.442672:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d51a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.442685:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d51a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135508.442726:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135508.442745:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d51a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.442772:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d513 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a8 expref: 64 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.442791:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d51a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a8 expref: 63 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.442841:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:3.0:1783135508.442845:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783135508.442848:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486200, rc 0) 00000100:00100000:3.0:1783135508.442910:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+63:11490:x1869752792331776:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 565us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135508.442918:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 181 00000100:00100000:3.0:1783135508.447840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.447874:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792331904 00000100:00100000:3.0:1783135508.447883:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792331904 00000100:00100000:3.0:1783135508.447936:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 51 00000100:00100000:3.0:1783135508.447946:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792331904:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135508.447966:0:8303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135508.447988:0:8303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120af expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135508.448017:0:8303:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487d14, blocks: 0x1 00010000:00010000:3.0:1783135508.448036:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:3.0:1783135508.448040:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135508.448049:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 8 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.448493:0:8303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 8 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.448509:0:8303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487c00, rc 0) 00000100:00100000:3.0:1783135508.448615:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+8:2361:x1869752792331904:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 670us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135508.448623:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 51 00000100:00100000:1.0:1783135508.452789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135508.452975:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792332160 00000100:00100000:2.0:1783135508.452985:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792332160 00000100:00100000:2.0:1783135508.453045:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 182 00000100:00100000:2.0:1783135508.453076:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+63:11490:x1869752792332160:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135508.453208:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+63:11490:x1869752792332160:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 153us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135508.453216:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 182 00000100:00100000:3.0:1783135508.458911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135508.459029:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792332288 00000100:00100000:2.0:1783135508.459039:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792332288 00000100:00100000:2.0:1783135508.459115:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 52 00000100:00100000:2.0:1783135508.459127:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+8:11490:x1869752792332288:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135508.459158:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135508.459178:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120b6 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.459213:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 9 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.459225:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135508.459244:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135508.459251:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.459290:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 9 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.459305:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 9 pid: 8303 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.459321:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1869752813300352:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135508.462325:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135508.470759:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c29880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1869752813300352:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135508.470797:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 9 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.470833:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c39800, rc 0) 00000100:00100000:0.0:1783135508.470898:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+9:11490:x1869752792332288:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 11773us (11996us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135508.470908:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 52 00000100:00100000:2.0:1783135508.496062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135508.496104:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792332416 00000100:00100000:2.0:1783135508.496113:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792332416 00010000:00010000:2.0:1783135508.496490:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 9 pid: 8303 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.496533:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 68 00000100:00100000:2.0:1783135508.496544:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+9:2361:x1869752792332416:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135508.496560:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135508.496583:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 9 pid: 8303 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.496598:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 9 pid: 8303 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.496926:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d521 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120af expref: 9 pid: 8303 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.496944:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135508.496949:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135508.496957:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.496967:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.497018:0:6604:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.497033:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c29880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6604:1869752813300480:192.168.201.60@tcp:105: 00000100:00100000:2.0:1783135508.497134:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f082623c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135508.509956:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.510693:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c29880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6604:1869752813300480:192.168.201.60@tcp:105: 00010000:00010000:3.0:1783135508.510721:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135508.510799:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+8:2361:x1869752792332416:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 14257us (14754us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135508.510810:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 68 00000100:00100000:3.0:1783135508.510875:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792332544 00000100:00100000:3.0:1783135508.510882:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792332544 00002000:00100000:3.0:1783135508.510925:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e8f3fcb5f80 x1869752792332544/t0(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:679/0 lens 504/0 e 0 to 0 dl 1783135519 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135508.510937:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3fcb5f80 with x1869752792332544 ext(0->8) 00002000:00010000:3.0:1783135508.510942:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3fcb5f80 00000100:00100000:3.0:1783135508.510973:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:3.0:1783135508.510982:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792332544:12345-192.168.201.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1783135508.513024:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c7819a6-778a-4617-af33-00460db74182+10:2360:x1869752792332544:12345-192.168.201.60@tcp:4:lhsmtool_posix.0 Request processed in 2031us (3065us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1783135508.513038:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4 00002000:00100000:3.0:1783135508.513062:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8e8f3fcb5f80 x1869752792332544/t4294967314(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:679/0 lens 504/448 e 0 to 0 dl 1783135519 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1783135508.513073:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3fcb5f80 with x1869752792332544 ext(0->8) 00002000:00010000:3.0:1783135508.513079:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3fcb5f80 00000100:00100000:0.0:1783135508.520059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135508.521595:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792332672 00000100:00100000:1.0:1783135508.521614:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792332672 00000100:00100000:1.0:1783135508.521693:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 183 00000100:00100000:1.0:1783135508.521705:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+63:11490:x1869752792332672:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1783135508.605215:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813300608:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605283:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135508.605321:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813301120:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605342:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135508.605374:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135508.605380:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813300736:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605400:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135508.605415:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813301248:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135508.605463:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813300864:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605485:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135508.605514:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135508.605519:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813300992:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605541:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135508.605574:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813300608 00000100:00100000:1.0:1783135508.605581:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813300608 00000100:00100000:1.0:1783135508.605626:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1783135508.605635:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813300608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605683:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813300608:12345-0@lo:400:kworker.0 Request processed in 49us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.605690:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1783135508.605722:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813301120 00000100:00100000:1.0:1783135508.605725:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813301120 00000100:00100000:1.0:1783135508.605751:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813300736 00000100:00100000:1.0:1783135508.605754:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813300736 00000100:00100000:1.0:1783135508.605766:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813300864 00000100:00100000:1.0:1783135508.605768:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813300864 00000100:00100000:1.0:1783135508.605779:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783135508.605785:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813301120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605838:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813301120:12345-0@lo:400:kworker.0 Request processed in 52us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.605844:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783135508.605857:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783135508.605863:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813300736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605889:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813300736:12345-0@lo:400:kworker.0 Request processed in 27us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.605895:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783135508.605906:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783135508.605912:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813300864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.605952:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813300864:12345-0@lo:400:kworker.0 Request processed in 40us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.605959:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1783135508.605980:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813301248 00000100:00100000:1.0:1783135508.605984:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813301248 00000100:00100000:1.0:1783135508.606007:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813300992 00000100:00100000:1.0:1783135508.606010:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813300992 00000100:00100000:1.0:1783135508.606030:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783135508.606036:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813301248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.606080:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813301248:12345-0@lo:400:kworker.0 Request processed in 44us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.606086:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783135508.606097:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783135508.606103:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813300992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.606131:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813300992:12345-0@lo:400:kworker.0 Request processed in 28us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.606137:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783135508.606182:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813300736:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.606195:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813301248:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.606203:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813300608:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.606213:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d854e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813301120:0@lo:400:kworker.0 00000100:00080000:1.0:1783135508.606237:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135508.606241:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135508.606255:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d854a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813300992:0@lo:400:kworker.0 00000100:00100000:1.0:1783135508.606273:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813300864:0@lo:400:kworker.0 00000001:00080000:2.0:1783135508.617299:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:2.0:1783135508.617338:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1783135508.617588:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c8bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+54:11490:x1869752792332672:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 Request processed in 95877us (97543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.617601:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 183 00000100:00100000:3.0:1783135508.620109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135508.620515:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792332800 00000100:00100000:1.0:1783135508.620526:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792332800 00000100:00100000:1.0:1783135508.620587:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 53 00000100:00100000:1.0:1783135508.620599:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+10:2361:x1869752792332800:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783135508.622965:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813301376:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783135508.623042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135508.623265:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813301376 00000100:00100000:3.0:1783135508.623273:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813301376 00000100:00100000:3.0:1783135508.623335:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1783135508.623348:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813301376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1783135508.623379:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1783135508.623424:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a487d11, atime: 0x6a487d11, ctime: 0x6a487d11, blocks: 0x1 00010000:00010000:3.0:1783135508.623433:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.623449:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1783135508.623453:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135508.623459:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.623475:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.623484:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.623492:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.623559:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783135508.625967:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813301376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2616us (2918us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783135508.625990:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000020:00080000:2.0:1783135508.626875:0:5817:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8f08b88c00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1783135508.626884:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f0ab1d400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f08b88540 00000020:00080000:2.0:1783135508.626888:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f0ab1d200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f3ced5800 00000001:00080000:2.0:1783135508.626970:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:2.0:1783135508.626975:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:2.0:1783135508.627007:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:2.0:1783135508.627066:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783135508.627206:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1783135508.627314:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813301504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1783135508.627372:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135508.627422:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813301504 00000100:00100000:2.0:1783135508.627430:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813301504 00000100:00100000:2.0:1783135508.627475:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135508.627484:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813301504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1783135508.627646:0:6589:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783135508.627650:0:6589:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783135508 00002000:00010000:2.0:1783135508.627652:0:6589:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1783135508.627654:0:6589:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783135508 -> 1783135508 00002000:00010000:2.0:1783135508.627656:0:6589:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783135508.627694:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3314:x1869752813301504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (320us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1783135508.627701:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:2.0:1783135508.627739:0:3314:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f37c2bb80/2, rc 0, transno 4294967315 00000100:00100000:2.0:1783135508.627745:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813301504:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1783135508.627873:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f3b9dc700/2, rc 0, transno 4294967307 00000100:00100000:0.0:1783135508.627879:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813301376:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1783135508.628592:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135508.628615:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.628630:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135508.628636:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.628649:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.628674:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.628683:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875d52f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.628939:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135508.628941:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135508.628943:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135508.697491:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+10:2361:x1869752792332800:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 Request processed in 76882us (77381us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.697505:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 53 00000001:00080000:0.0:1783135508.699083:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:0.0:1783135508.699112:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:3.0:1783135508.706567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135508.706624:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792333056 00000100:00100000:1.0:1783135508.706635:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792333056 00000100:00100000:1.0:1783135508.706706:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 184 00000100:00100000:1.0:1783135508.706718:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+18:11490:x1869752792333056:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783135508.706939:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135508.706969:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d51a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a8 expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.706985:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:1.0:1783135508.706990:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135508.707024:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.707038:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.707058:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135508.707355:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000153488d5 reply state 00000000f8b9a67e transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135508.707714:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135508.707941:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+19:11490:x1869752792333056:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 1225us (1382us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1783135508.707950:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 184 00010000:00010000:3.0:1783135508.711535:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.711558:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.711566:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.711572:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135508.711578:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.711587:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.711603:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:3.0:1783135508.711606:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135508.711610:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.711616:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d536 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135508.714300:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.714479:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792333184 00000100:00100000:3.0:1783135508.714490:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792333184 00000100:00100000:3.0:1783135508.714552:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 56 00000100:00100000:3.0:1783135508.714563:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792333184:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1783135508.714931:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1783135508.714935:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783135508 -> 1783135506 00002000:00010000:3.0:1783135508.714937:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783135505 00002000:00010000:3.0:1783135508.714940:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783135508 -> 1783135506 00002000:00010000:3.0:1783135508.714942:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1783135508.715011:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792333184:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 450us (724us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783135508.715019:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 56 00000100:00100000:1.0:1783135508.717361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.717508:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792333440 00000100:00100000:3.0:1783135508.717516:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792333440 00000100:00100000:3.0:1783135508.717603:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 185 00000100:00100000:3.0:1783135508.717613:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+18:11490:x1869752792333440:12345-192.168.201.60@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783135508.717683:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.717701:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.717711:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.717763:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 18 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.717777:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 18 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135508.717810:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b81880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813301632:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135508.717907:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3db37300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135508.732292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135508.732369:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792333568 00000100:00100000:2.0:1783135508.732380:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792333568 00000100:00100000:1.0:1783135508.732421:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b81880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813301632:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135508.732434:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 19 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.732457:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.732487:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:2.0:1783135508.732498:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+19:2360:x1869752792333568:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135508.732516:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135508.732531:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 19 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.732557:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 19 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.732586:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d4fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1209a expref: 19 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.732608:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:2.0:1783135508.732614:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.732625:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.732634:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.732657:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135508.732689:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.732698:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.732717:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02ce1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+18:2360:x1869752792333568:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 220us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135508.732737:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 69 00010000:00010000:1.0:1783135508.732740:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.732749:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.732764:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.732770:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135508.732775:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.732783:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.732800:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:1.0:1783135508.732803:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783135508.732807:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.732833:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d53d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135508.732874:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+17:11490:x1869752792333440:12345-192.168.201.60@tcp:55:lhsmtool_posix.0 Request processed in 15263us (15527us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783135508.732882:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 185 00000100:00100000:2.0:1783135508.736214:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135508.736290:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792333696 00000100:00100000:0.0:1783135508.736301:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792333696 00000100:00100000:0.0:1783135508.736364:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:0.0:1783135508.736374:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+8:2361:x1869752792333696:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783135508.736424:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.736444:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.736452:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783135508.736456:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135508.736459:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.736491:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.736504:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 8 pid: 6587 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135508.736517:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813301760:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135508.736659:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135508.753517:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135508.753644:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792333824 00000100:00100000:2.0:1783135508.753657:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792333824 00010000:00010000:2.0:1783135508.753705:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 9 pid: 6587 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.753746:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:2.0:1783135508.753762:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792333824:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135508.753779:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135508.753801:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 9 pid: 6587 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.753833:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 9 pid: 6587 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.753868:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135508.753873:0:5782:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135508.753881:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.753891:0:5782:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135508.753913:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135508.754037:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c695fd8/0xf646e0cda875d528 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120b6 expref: 9 pid: 6587 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135508.754079:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813301760:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135508.754105:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754117:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754125:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754149:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754159:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754168:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754176:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135508.754181:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754190:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754211:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.754219:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000addefe20/0xf646e0cda875d544 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135508.761317:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792333824:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 6854us (7113us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135508.761337:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:1.0:1783135508.762279:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792333696:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 Request processed in 25898us (26068us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.762294:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:0.0:1783135508.774801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135508.774896:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792334080 00000100:00100000:1.0:1783135508.774908:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792334080 00000100:00100000:1.0:1783135508.774966:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 186 00000100:00100000:1.0:1783135508.774977:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+17:11490:x1869752792334080:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783135508.775070:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.775091:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.775103:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.775358:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.775369:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.775378:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.775419:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.775432:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 18 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135508.775447:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d855c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813301888:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135508.775536:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02cc0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783135508.779404:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d855c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813301888:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135508.779441:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135508.780572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.780862:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792334208 00000100:00100000:3.0:1783135508.780872:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792334208 00010000:00010000:3.0:1783135508.780912:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 19 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135508.780947:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 71 00000100:00100000:3.0:1783135508.780955:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+19:2361:x1869752792334208:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135508.780970:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135508.780977:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 19 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.780989:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 19 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.781011:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875d50c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120a1 expref: 19 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.781024:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:3.0:1783135508.781029:0:6604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.781058:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.781065:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.781092:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135508.781147:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+18:2361:x1869752792334208:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 191us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135508.781155:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 71 00010000:00010000:0.0:1783135508.784831:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.784853:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135508.785230:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1783135508.785393:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1783135508.785437:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1783135508.785535:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b81880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1869752813302016:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135508.785606:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135508.785694:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135508.789026:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813302016 00000100:00100000:0.0:1783135508.789056:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813302016 00000100:00100000:0.0:1783135508.789139:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135508.789152:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1869752813302016:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1783135508.789460:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5796:x1869752813302016:12345-0@lo:1000:mdt00_002.0 Request processed in 310us (3853us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135508.789469:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135508.789559:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b81880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1869752813302016:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1783135508.791934:0:5796:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1783135508.792081:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10b5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1869752813302144:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783135508.792280:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135508.792320:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135508.792339:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813302144 00000100:00100000:2.0:1783135508.792349:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813302144 00000100:00100000:2.0:1783135508.792413:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135508.792424:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5796:x1869752813302144:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783135508.792762:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5796:x1869752813302144:12345-0@lo:1000:mdt00_002.0 Request processed in 339us (481us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1783135508.792779:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135508.792884:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10b5c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5796:1869752813302144:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1783135508.792933:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.792946:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.792963:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.792971:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135508.792977:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.792985:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793005:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f10923000) 00010000:00010000:0.0:1783135508.793008:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135508.793013:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793019:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875d552 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793064:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793070:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793075:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793080:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135508.793083:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793098:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793109:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:0.0:1783135508.793111:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135508.793114:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793120:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c800/0xf646e0cda875d487 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793148:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793163:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793173:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793286:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 21 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135508.793306:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 21 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135508.793321:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813302272:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135508.793412:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135508.801547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.801682:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9ded80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813302272:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135508.801712:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135508.802002:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792334336 00000100:00100000:1.0:1783135508.802009:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792334336 00010000:00010000:1.0:1783135508.802060:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 22 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135508.802143:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 72 00000100:00100000:1.0:1783135508.802164:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+22:2360:x1869752792334336:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135508.802182:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135508.802189:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 22 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.802216:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 22 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.802242:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042000/0xf646e0cda875d4a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12085 expref: 22 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.802260:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:1.0:1783135508.802266:0:11521:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.802277:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.802286:0:11521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135508.802314:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135508.802370:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+21:2360:x1869752792334336:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 216us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135508.802378:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 72 00010000:00010000:3.0:1783135508.802651:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802671:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802685:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802693:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802700:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802705:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135508.802710:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802716:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802726:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:3.0:1783135508.802729:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135508.802743:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802751:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d559 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802764:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802777:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802791:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802798:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121dc00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135508.802801:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802809:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802943:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f10923700) 00010000:00010000:3.0:1783135508.802947:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135508.802951:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.802958:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121dc00/0xf646e0cda875d54b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135508.803264:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+20:11490:x1869752792334080:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 28285us (28470us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1783135508.803273:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 186 00000020:00080000:3.0:1783135508.803278:0:5796:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783135508.803415:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135508.803420:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135508.803962:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1783135508.803978:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783135508.815958:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.816074:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792334592 00000100:00100000:3.0:1783135508.816085:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792334592 00000100:00100000:3.0:1783135508.816191:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 50 00000100:00100000:3.0:1783135508.816203:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26327c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+20:11490:x1869752792334592:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783135508.819247:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783135508.819506:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1783135508.819590:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.819609:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.819623:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.819634:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.819641:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.819647:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.819676:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783135508.819877:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26327c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+22:11490:x1869752792334592:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 3671us (3924us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1783135508.819887:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 50 00000020:00080000:3.0:1783135508.819894:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135508.824454:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135508.824473:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.824488:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487800 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135508.824493:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.824515:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.824537:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135508.824541:0:6603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783135508.824546:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.824552:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d560 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.824581:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135508.824583:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135508.824585:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135508.828439:0:12262:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135508.828448:0:12262:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135508.828483:0:12262:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1783135508.828495:0:12262:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135508.952346:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.952486:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792334848 00000100:00100000:3.0:1783135508.952495:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792334848 00000100:00100000:3.0:1783135508.952550:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 187 00000100:00100000:3.0:1783135508.952560:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+22:11500:x1869752792334848:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135508.952585:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135508.952603:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120bd expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.952902:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d56e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.952927:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d56e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.952939:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d56e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135508.952951:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783135508.953145:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120bd expref: 25 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.953162:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d56e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120bd expref: 24 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.953171:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:3.0:1783135508.953174:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135508.953177:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487800, rc 0) 00000100:00100000:3.0:1783135508.953245:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+24:11500:x1869752792334848:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 687us (908us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1783135508.953253:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 187 00000100:00100000:0.0:1783135508.964541:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135508.965269:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792334976 00000100:00100000:3.0:1783135508.965280:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792334976 00000100:00100000:3.0:1783135508.965352:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 188 00000100:00100000:3.0:1783135508.965362:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+24:11500:x1869752792334976:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:3.0:1783135508.965436:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965455:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965484:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965499:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965507:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965513:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965794:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965802:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965809:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135508.965878:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965891:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965897:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965903:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965920:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135508.965925:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965932:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965944:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:3.0:1783135508.965947:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135508.965951:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965957:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d57c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965968:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965974:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965979:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965984:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135508.965987:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.965993:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966010:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f08840100) 00010000:00010000:3.0:1783135508.966013:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135508.966015:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966021:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d583 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966036:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966056:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966062:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966067:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135508.966069:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966074:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966081:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840500) 00010000:00010000:3.0:1783135508.966084:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135508.966087:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135508.966091:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d58a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135508.966408:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+24:11500:x1869752792334976:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 1045us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135508.966417:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 188 00000100:00100000:1.0:1783135509.048565:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135509.048753:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792335232 00000100:00100000:3.0:1783135509.048763:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792335232 00000100:00100000:3.0:1783135509.048863:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 189 00000100:00080000:1.0:1783135509.048936:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135509.049064:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+24:11503:x1869752792335232:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135509.049086:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135509.049107:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d591 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120c4 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.049257:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.049272:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.049284:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.049300:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.049308:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.049315:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.050794:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.050807:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.050947:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135509.050960:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1783135509.051074:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051081:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051089:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051095:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135509.051099:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051107:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051119:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:3.0:1783135509.051122:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135509.051126:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051276:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d598 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051291:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051297:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051303:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051309:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135509.051312:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051317:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051452:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f08840500) 00010000:00010000:3.0:1783135509.051456:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135509.051460:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051466:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d59f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051516:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d591 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 27 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051531:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.051545:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135509.051547:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135509.051550:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487200, rc 0) 00000100:00100000:3.0:1783135509.051748:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d855c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+26:11503:x1869752792335232:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2875us (3191us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1783135509.057025:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 189 00000100:00100000:0.0:1783135509.057477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135509.057516:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792335360 00000100:00100000:2.0:1783135509.057526:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792335360 00000100:00100000:2.0:1783135509.057623:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 190 00000100:00100000:2.0:1783135509.057634:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+26:11503:x1869752792335360:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:2.0:1783135509.057705:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057721:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057732:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057760:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057767:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057774:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057780:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135509.057784:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057790:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057851:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:2.0:1783135509.057854:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135509.057859:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.057865:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135509.057943:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db59880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+26:11503:x1869752792335360:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 311us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135509.057951:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 190 00000100:00100000:1.0:1783135509.061414:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135509.061757:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792335616 00000100:00100000:0.0:1783135509.061768:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792335616 00000100:00100000:0.0:1783135509.061833:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 51 00000100:00100000:0.0:1783135509.061843:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+26:11503:x1869752792335616:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135509.062097:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+27:11503:x1869752792335616:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 255us (692us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1783135509.062105:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 51 00000100:00100000:1.0:1783135509.102530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135509.102956:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792335872 00000100:00100000:2.0:1783135509.102967:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792335872 00000100:00100000:2.0:1783135509.103026:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 191 00000100:00100000:2.0:1783135509.103036:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+27:11037:x1869752792335872:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135509.103070:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135509.103089:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120cb expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.103204:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.103220:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.103229:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.103264:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 28 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.103291:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 28 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135509.103304:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3cba2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813302400:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135509.103556:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262780 going to sleep for 11 seconds 00000100:00100000:1.0:1783135509.107889:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3cba2680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813302400:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135509.107919:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135509.110558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135509.110807:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792336000 00000100:00100000:0.0:1783135509.110849:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792336000 00010000:00010000:0.0:1783135509.110896:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 29 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135509.110944:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 73 00000100:00100000:0.0:1783135509.110955:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+29:2361:x1869752792336000:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135509.110972:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135509.110980:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 29 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.110992:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 29 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.111015:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d5a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120c4 expref: 29 pid: 5795 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.111061:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:0.0:1783135509.111067:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.111076:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.111084:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.111105:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135509.111151:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+28:2361:x1869752792336000:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 198us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135509.111157:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 73 00010000:00010000:1.0:1783135509.111281:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.111288:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135509.111303:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1783135509.111425:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.111436:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.111442:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:1.0:1783135509.111444:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783135509.111446:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c39e00, rc 0) 00000100:00100000:1.0:1783135509.111467:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+28:11037:x1869752792335872:12345-192.168.201.60@tcp:101:bash.0 Request processed in 8435us (8950us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1783135509.111472:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 191 00000100:00100000:2.0:1783135509.120546:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135509.120624:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792336256 00000100:00100000:3.0:1783135509.120635:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792336256 00000100:00100000:3.0:1783135509.120696:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 192 00000100:00100000:3.0:1783135509.120706:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+28:11037:x1869752792336256:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:3.0:1783135509.121007:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.121026:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.121037:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135509.121101:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1783135509.121130:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d75f7f17 reply state 00000000ef28cb22 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135509.121140:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1783135509.121191:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1783135509.121301:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+32:11037:x1869752792336256:12345-192.168.201.60@tcp:36:bash.0 Request processed in 595us (763us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1783135509.121310:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 192 00000020:00080000:3.0:1783135509.121328:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783135509.124569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135509.124596:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792336384 00000100:00100000:3.0:1783135509.124606:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792336384 00000100:00100000:3.0:1783135509.124655:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 193 00000100:00100000:3.0:1783135509.124662:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+32:11037:x1869752792336384:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1783135509.124685:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135509.124702:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d5d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120d2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.124759:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d5d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d2 expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.124774:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d5d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d2 expref: 33 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.124794:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135509.124797:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783135509.124801:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487a00, rc 0) 00000100:00100000:3.0:1783135509.124876:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+33:11037:x1869752792336384:12345-192.168.201.60@tcp:101:bash.0 Request processed in 213us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135509.124883:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 193 00010000:00010000:0.0:1783135509.125388:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.125399:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.125405:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.125411:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135509.125415:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.125423:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.125452:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:0.0:1783135509.125454:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135509.125459:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.125464:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d5d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135509.171598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135509.171786:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792336512 00000100:00100000:3.0:1783135509.171796:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792336512 00000100:00100000:3.0:1783135509.171886:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 58 00000100:00100000:3.0:1783135509.171895:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:11037:x1869752792336512:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:3.0:1783135509.171912:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135509.171943:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120d9 expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135509.171970:0:6587:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a487d12, atime: 0x6a487d11, ctime: 0x6a487d12, blocks: 0xb 00010000:00010000:3.0:1783135509.171993:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1783135509.171997:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135509.172005:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.172021:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.172035:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486800, rc 0) 00000100:00100000:3.0:1783135509.172117:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+8:11037:x1869752792336512:12345-192.168.201.60@tcp:101:bash.0 Request processed in 222us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135509.172125:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 58 00000100:00080000:2.0:1783135509.172230:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135509.183333:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135509.184862:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792336640 00000100:00100000:0.0:1783135509.184877:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792336640 00002000:00010000:0.0:1783135509.184926:0:6593:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1783135509.184932:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3fcb4e00 with x1869752792336640 ext(0->18446744073709551615) 00002000:00010000:0.0:1783135509.184945:0:6593:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3fcb4e00. 00000100:00100000:0.0:1783135509.184981:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:0.0:1783135509.184992:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+8:2361:x1869752792336640:12345-192.168.201.60@tcp:10:bash.0 00002000:00010000:0.0:1783135509.185284:0:6593:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783135509.185288:0:6593:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1783135506 -> 1783135508 00002000:00010000:0.0:1783135509.185291:0:6593:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1783135505 -> 1783135505 00002000:00010000:0.0:1783135509.185293:0:6593:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1783135506 -> 1783135508 00002000:00010000:0.0:1783135509.185295:0:6593:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1783135509.185360:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+9:2361:x1869752792336640:12345-192.168.201.60@tcp:10:bash.0 Request processed in 369us (2038us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1783135509.185369:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5 00002000:00010000:0.0:1783135509.185373:0:6593:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1783135509.185375:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3fcb4e00 with x1869752792336640 ext(0->18446744073709551615) 00002000:00010000:0.0:1783135509.185394:0:6593:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3fcb4e00. 00000001:00080000:3.0:1783135509.216302:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1783135509.216323:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1783135509.216343:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:3.0:1783135509.311083:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135509.311222:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792336768 00000100:00100000:2.0:1783135509.311232:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792336768 00000100:00100000:2.0:1783135509.311296:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 194 00000100:00100000:2.0:1783135509.311307:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+32:11517:x1869752792336768:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:2.0:1783135509.311391:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311408:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311420:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311437:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311443:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311450:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311747:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311756:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311764:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135509.311806:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311851:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311858:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311864:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311871:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135509.311874:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311882:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311893:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:2.0:1783135509.311896:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135509.311901:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311913:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d5e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311927:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311931:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311936:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311940:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135509.311943:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311948:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311955:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f18315a00) 00010000:00010000:2.0:1783135509.311957:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135509.311960:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311966:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d5ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311979:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311986:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.311997:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.312002:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135509.312004:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.312011:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.312018:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:2.0:1783135509.312021:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135509.312023:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.312028:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d5f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135509.312122:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cf55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+32:11517:x1869752792336768:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 816us (1047us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135509.312130:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 194 00000100:00100000:0.0:1783135509.375449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135509.375572:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792337024 00000100:00100000:3.0:1783135509.375581:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792337024 00000100:00100000:3.0:1783135509.375781:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 195 00000100:00100000:3.0:1783135509.375792:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+32:11520:x1869752792337024:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135509.375852:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135509.375873:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d5fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120e0 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.375971:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.375987:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.375999:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376029:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376046:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376053:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376394:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d60f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376404:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376412:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d60f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135509.376423:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783135509.376518:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376526:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376540:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376546:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135509.376551:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376559:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376572:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:3.0:1783135509.376575:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135509.376580:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376587:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d601 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376744:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376753:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376759:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376764:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135509.376767:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376783:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376793:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f08840300) 00010000:00010000:3.0:1783135509.376795:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135509.376798:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376804:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d608 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376886:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d5fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120e0 expref: 35 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376900:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d60f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120e0 expref: 34 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.376907:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135509.376910:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783135509.376912:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486a00, rc 0) 00000100:00100000:3.0:1783135509.376983:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+34:11520:x1869752792337024:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1193us (1545us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1783135509.376991:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 195 00000100:00100000:3.0:1783135509.380294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135509.380528:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792337152 00000100:00100000:2.0:1783135509.380538:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792337152 00000100:00100000:2.0:1783135509.380658:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 196 00000100:00100000:2.0:1783135509.380670:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+34:11520:x1869752792337152:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:2.0:1783135509.380740:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.380755:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.380779:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.380854:0:9499:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 34 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.380868:0:9499:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 34 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135509.380882:0:9499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fd47100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752813302528:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135509.380969:0:9499:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f089c1540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135509.384556:0:9499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fd47100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9499:1869752813302528:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135509.384587:0:9499:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135509.387480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135509.387691:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792337408 00000100:00100000:0.0:1783135509.387700:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792337408 00000100:00100000:0.0:1783135509.387762:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 52 00000100:00100000:0.0:1783135509.387773:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+35:5576:x1869752792337408:12345-192.168.201.60@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1783135509.388095:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:0.0:1783135509.388206:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+37:5576:x1869752792337408:12345-192.168.201.60@tcp:35:ldlm_bl.0 Request processed in 434us (735us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1783135509.388215:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 52 00000020:00080000:0.0:1783135509.388220:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1783135509.392200:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135509.392291:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792337536 00000100:00100000:3.0:1783135509.392306:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792337536 00010000:00010000:3.0:1783135509.392362:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 37 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135509.392405:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 74 00000100:00100000:3.0:1783135509.392414:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+37:2360:x1869752792337536:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135509.392430:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135509.392437:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 37 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.392450:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 37 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.392472:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d5c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120cb expref: 37 pid: 5794 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.392488:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:3.0:1783135509.392493:0:5780:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.392501:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.392508:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.392562:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135509.392630:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+36:2360:x1869752792337536:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 216us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135509.392640:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 74 00010000:00010000:0.0:1783135509.392762:0:9499:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.392771:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.392805:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.392857:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.392866:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.392872:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135509.392877:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.392896:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.392905:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:0.0:1783135509.392908:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135509.392912:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.392918:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d61d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135509.392957:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+35:11520:x1869752792337152:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 12290us (12674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135509.392964:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 196 00000100:00100000:1.0:1783135509.396680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135509.396765:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792337792 00000100:00100000:0.0:1783135509.396775:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792337792 00000100:00100000:0.0:1783135509.396876:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 53 00000100:00100000:0.0:1783135509.396886:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+35:11520:x1869752792337792:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135509.397141:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+36:11520:x1869752792337792:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 248us (464us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1783135509.397149:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 53 00010000:00010000:3.0:1783135509.434106:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135509.537972:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135509.538175:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792338048 00000100:00100000:3.0:1783135509.538185:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792338048 00000100:00100000:3.0:1783135509.538303:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 197 00000100:00100000:3.0:1783135509.538314:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+36:11531:x1869752792338048:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:3.0:1783135509.538350:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135509.538372:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d624 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120e7 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.538443:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.538458:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.538469:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.538484:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.538491:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.538498:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.541327:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d639 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.541419:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.541432:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d639 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135509.541445:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1783135509.541846:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.541854:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.541861:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.541881:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135509.541887:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.541894:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.541907:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:2.0:1783135509.541909:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135509.541914:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542093:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d62b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542110:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542116:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542122:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542248:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135509.542252:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542259:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542278:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f08840300) 00010000:00010000:2.0:1783135509.542281:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135509.542284:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542289:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d632 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542416:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d624 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120e7 expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542431:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d639 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120e7 expref: 38 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.542439:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:2.0:1783135509.542441:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135509.542444:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38a00, rc 0) 00000100:00100000:2.0:1783135509.543042:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+38:11531:x1869752792338048:12345-192.168.201.60@tcp:101:cat.0 Request processed in 4719us (5067us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1783135509.543052:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 197 00000100:00100000:3.0:1783135509.552907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135509.555575:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792338304 00000100:00100000:0.0:1783135509.555587:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792338304 00000100:00100000:0.0:1783135509.555967:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 54 00000100:00100000:0.0:1783135509.555979:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+38:11531:x1869752792338304:12345-192.168.201.60@tcp:35:cat.0 00000100:00100000:0.0:1783135509.556350:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+39:11531:x1869752792338304:12345-192.168.201.60@tcp:35:cat.0 Request processed in 372us (3452us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1783135509.556371:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 54 00000100:00100000:1.0:1783135509.588998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135509.589572:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792338560 00000100:00100000:2.0:1783135509.589582:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792338560 00000100:00100000:2.0:1783135509.589661:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 198 00000100:00100000:2.0:1783135509.589672:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+39:11532:x1869752792338560:12345-192.168.201.60@tcp:36:rm.0 00010000:00010000:2.0:1783135509.589732:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783135509.589760:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d639 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120e7 expref: 39 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.589803:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d60f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120e0 expref: 38 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.589871:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d5d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d2 expref: 37 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.589883:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f08840100) 00010000:00010000:2.0:1783135509.589896:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135509.589916:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.589928:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.589937:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.589950:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.589957:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.589963:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.590917:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.590930:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.590945:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135509.592951:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1783135509.592970:0:5795:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 409022153468ns, next at 410022148329ns, rc = 0 00010000:00010000:2.0:1783135509.593068:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593083:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593093:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593101:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593107:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593114:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593343:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135509.593367:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593374:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593380:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593396:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135509.593401:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593408:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593422:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315900) 00010000:00010000:2.0:1783135509.593425:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783135509.593429:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593436:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39400/0xf646e0cda875d655 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593456:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593462:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593468:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593473:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135509.593476:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593482:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593501:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:2.0:1783135509.593504:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135509.593507:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.593513:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38600/0xf646e0cda875d647 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135509.593525:0:5795:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008b720b62 reply state 0000000015d03c92 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135509.593535:0:5795:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135509.593786:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+38:11532:x1869752792338560:12345-192.168.201.60@tcp:36:rm.0 Request processed in 4112us (4793us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1783135509.593796:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 198 00010000:00010000:1.0:1783135509.594536:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135509.594544:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.594569:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135509.594573:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.594581:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.594594:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8e8f18315900) 00010000:00010000:1.0:1783135509.594597:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783135509.594707:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.594714:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d65c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.594735:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135509.594737:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135509.594739:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135509.600895:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.600913:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.600920:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.600926:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135509.600931:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.600939:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.600956:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f18315a00) 00010000:00010000:3.0:1783135509.600960:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135509.600964:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.600969:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39c00/0xf646e0cda875d64e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135509.686993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135509.687116:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792338816 00000100:00100000:0.0:1783135509.687126:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792338816 00000100:00100000:0.0:1783135509.687218:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 199 00000100:00100000:0.0:1783135509.687229:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+37:11538:x1869752792338816:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135509.687266:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135509.687287:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042800/0xf646e0cda875d663 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120ee expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.687460:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.687477:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.687489:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.687504:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.687512:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.687519:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135509.688364:0:5796:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1783135509.688534:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.688554:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.688562:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.689585:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.689598:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.689997:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.690003:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135509.690007:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.690015:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.690041:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135509.690044:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135509.690049:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.690055:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d66a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135509.690073:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004e6631c1 reply state 000000000be91533 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135509.690095:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135509.690153:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042800/0xf646e0cda875d663 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 40 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.690169:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 39 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.690176:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135509.690177:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135509.690180:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043e00, rc 0) 00000100:00100000:0.0:1783135509.690262:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+40:11538:x1869752792338816:12345-192.168.201.60@tcp:101:bash.0 Request processed in 3034us (3280us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1783135509.690270:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 199 00010000:00010000:0.0:1783135509.694884:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.694903:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.694911:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.694917:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135509.694922:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.694929:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.694965:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135509.694968:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135509.694973:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.694979:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d671 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135509.699454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135509.699632:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792338944 00000100:00100000:2.0:1783135509.699643:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792338944 00000100:00100000:2.0:1783135509.699860:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 59 00000100:00100000:2.0:1783135509.699872:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792338944:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:2.0:1783135509.699895:0:8303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135509.699919:0:8303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120f5 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135509.699947:0:8303:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135509.699967:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=409s v=(0 0) 00010000:00010000:2.0:1783135509.699971:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135509.699981:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 6 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.700021:0:8303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 6 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135509.700044:0:8303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38600, rc 0) 00000100:00100000:2.0:1783135509.700107:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+6:2363:x1869752792338944:12345-192.168.201.60@tcp:101:bash.0 Request processed in 237us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135509.700114:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 59 00000100:00100000:3.0:1783135509.706559:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135509.706651:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792339072 00000100:00100000:0.0:1783135509.706661:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792339072 00000100:00100000:0.0:1783135509.706727:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 60 00000100:00100000:0.0:1783135509.706738:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+6:11538:x1869752792339072:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135509.706755:0:6589:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135509.706773:0:6589:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab120fc expref: -99 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.706803:0:6589:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 7 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.706848:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135509.706853:0:6589:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135509.706859:0:6589:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.706917:0:6589:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 7 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135509.706943:0:6589:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 7 pid: 8303 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135509.706956:0:6589:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1869752813302656:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135509.707057:0:6589:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c00c0 going to sleep for 11 seconds 00000100:00080000:1.0:1783135509.710802:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135509.714900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135509.715074:0:6589:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c70380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6589:1869752813302656:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135509.715119:0:6589:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 7 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135509.715178:0:6589:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042800, rc 0) 00000100:00100000:3.0:1783135509.715247:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:11538:x1869752792339072:12345-192.168.201.60@tcp:101:bash.0 Request processed in 8511us (8699us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135509.715257:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 60 00000100:00100000:1.0:1783135509.715865:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792339200 00000100:00100000:1.0:1783135509.715874:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792339200 00010000:00010000:1.0:1783135509.715906:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 7 pid: 8303 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135509.715944:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 75 00000100:00100000:1.0:1783135509.715952:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792339200:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135509.715967:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135509.716000:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 7 pid: 8303 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.716014:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 7 pid: 8303 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.716051:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d20ab384/0xf646e0cda875d686 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120f5 expref: 7 pid: 8303 timeout: 509 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.716065:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135509.716069:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135509.716077:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.716087:0:11521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135509.716130:0:11521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135509.716145:0:11521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11521:1869752813302784:192.168.201.60@tcp:105: 00000100:00100000:1.0:1783135509.716214:0:11521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02e4e180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135509.725414:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135509.726993:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792339456 00000100:00100000:2.0:1783135509.727006:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792339456 00000100:00100000:2.0:1783135509.727090:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 55 00000100:00100000:2.0:1783135509.727101:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+39:11538:x1869752792339456:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:2.0:1783135509.728075:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+40:11538:x1869752792339456:12345-192.168.201.60@tcp:35:bash.0 Request processed in 970us (2669us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783135509.728085:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 55 00000100:00100000:1.0:1783135509.728465:0:11521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:11521:1869752813302784:192.168.201.60@tcp:105: 00010000:00010000:1.0:1783135509.728490:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135509.728598:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+6:2361:x1869752792339200:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 12644us (13706us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135509.728607:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 75 00000100:00100000:2.0:1783135510.037365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.037523:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792339584 00000100:00100000:0.0:1783135510.037533:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792339584 00000100:00100000:0.0:1783135510.037594:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 200 00000100:00100000:0.0:1783135510.037622:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+40:11554:x1869752792339584:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135510.037647:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135510.037987:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d694 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12103 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.038069:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d69b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.038083:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.038096:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135510.038193:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1783135510.038197:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135510.038221:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d69b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.038245:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d694 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12103 expref: 42 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.038264:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d69b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12103 expref: 41 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.038273:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135510.038277:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135510.038280:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042200, rc 0) 00000100:00100000:0.0:1783135510.038593:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+41:11554:x1869752792339584:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 989us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135510.038615:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 200 00000100:00100000:2.0:1783135510.054418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.054534:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792339840 00000100:00100000:0.0:1783135510.054545:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792339840 00000100:00100000:0.0:1783135510.054625:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 201 00000100:00100000:0.0:1783135510.054637:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+41:11554:x1869752792339840:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135510.054675:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135510.054698:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d6a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1210a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.054845:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d6a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.054883:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.054897:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d6a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135510.054912:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1783135510.055082:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042a00/0xf646e0cda875d6a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1210a expref: 44 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.055102:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d6a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1210a expref: 43 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.055112:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135510.055115:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135510.055119:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043c00, rc 0) 00000100:00100000:0.0:1783135510.055198:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10531500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+43:11554:x1869752792339840:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 563us (790us total) trans 4294967485 rc 0/0 00000100:00100000:0.0:1783135510.055206:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 201 00000100:00100000:1.0:1783135510.060548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.060984:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792340096 00000100:00100000:2.0:1783135510.060995:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792340096 00000100:00100000:2.0:1783135510.061070:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 202 00000100:00100000:2.0:1783135510.061080:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+43:11554:x1869752792340096:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135510.061108:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135510.061137:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39000/0xf646e0cda875d6b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12111 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.061261:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875d6be lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.061276:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875d6be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.061289:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875d6be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135510.061302:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783135510.062282:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39000/0xf646e0cda875d6b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12111 expref: 46 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.062303:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875d6be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12111 expref: 45 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.063277:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:2.0:1783135510.063280:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783135510.063283:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38800, rc 0) 00000100:00100000:2.0:1783135510.063392:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+45:11554:x1869752792340096:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2310us (2852us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1783135510.063402:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 202 00000100:00100000:1.0:1783135510.067875:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.067993:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792340224 00000100:00100000:2.0:1783135510.068003:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792340224 00000100:00100000:2.0:1783135510.068087:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:2.0:1783135510.068098:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+45:2361:x1869752792340224:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135510.068122:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135510.068157:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043c00/0xf646e0cda875d6a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1210a expref: 45 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.068180:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:2.0:1783135510.068186:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135510.068253:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02ce1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+44:2361:x1869752792340224:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 157us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135510.068262:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:3.0:1783135510.078014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.078131:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792340352 00000100:00100000:2.0:1783135510.078141:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792340352 00000100:00100000:2.0:1783135510.078196:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:2.0:1783135510.078206:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+6:2360:x1869752792340352:12345-192.168.201.60@tcp:1:lfs.0 00010000:00010000:2.0:1783135510.078252:0:8303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.078273:0:8303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.078282:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135510.078286:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135510.078290:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.078343:0:8303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 6 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.078357:0:8303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 6 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135510.078384:0:8303:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8303:1869752813302912:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135510.078484:0:8303:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135510.082105:0:8303:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f10532680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8303:1869752813302912:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135510.082144:0:8303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135510.084386:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.084558:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792340480 00000100:00100000:0.0:1783135510.084567:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792340480 00002000:00100000:0.0:1783135510.084624:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e8f02c63480 x1869752792340480/t0(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:681/0 lens 504/0 e 0 to 0 dl 1783135521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135510.084635:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f02c63480 with x1869752792340480 ext(0->8) 00010000:00010000:0.0:1783135510.084645:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 7 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.084695:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 7 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135510.084703:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8f02c63480 00000100:00100000:0.0:1783135510.084740:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:0.0:1783135510.084752:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792340480:12345-192.168.201.60@tcp:4:lfs.0 00000100:00100000:0.0:1783135510.085610:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0c7819a6-778a-4617-af33-00460db74182+9:2361:x1869752792340480:12345-192.168.201.60@tcp:4:lfs.0 Request processed in 857us (1229us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1783135510.085620:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3 00002000:00100000:0.0:1783135510.085629:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8e8f02c63480 x1869752792340480/t4294967308(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:681/0 lens 504/448 e 0 to 0 dl 1783135521 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135510.085637:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f02c63480 with x1869752792340480 ext(0->8) 00010000:00010000:0.0:1783135510.085643:0:6594:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 9 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.085668:0:6594:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 9 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135510.085675:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8e8f02c63480 00000100:00100000:1.0:1783135510.094542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.095538:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792340608 00000100:00100000:2.0:1783135510.095551:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792340608 00010000:00010000:2.0:1783135510.095596:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 9 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135510.095871:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 76 00000100:00100000:2.0:1783135510.095882:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792340608:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135510.095902:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783135510.095922:0:5781:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783135510.095925:0:5781:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783135509 00002000:00010000:2.0:1783135510.095927:0:5781:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783135509 00002000:00010000:2.0:1783135510.095929:0:5781:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783135509 00010000:00010000:2.0:1783135510.095935:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 9 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.095948:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 9 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.095996:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c1234f0b/0xf646e0cda875d68d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120fc expref: 9 pid: 6589 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.096014:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135510.096018:0:5781:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135510.096033:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.096045:0:5781:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.096082:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135510.096153:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792340608:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 273us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135510.096162:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 76 00010000:00010000:1.0:1783135510.096221:0:8303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.096239:0:8303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.096266:0:8303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.096276:0:8303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.096284:0:8303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.096291:0:8303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39000 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135510.096295:0:8303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.096313:0:8303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.096333:0:8303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.096341:0:8303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8a86861/0xf646e0cda875d6cc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135510.096401:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792340352:12345-192.168.201.60@tcp:1:lfs.0 Request processed in 18197us (18398us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135510.096410:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:1.0:1783135510.100285:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135510.100523:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792340864 00000100:00100000:3.0:1783135510.100533:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792340864 00000100:00100000:3.0:1783135510.100605:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 56 00000100:00100000:3.0:1783135510.100615:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26327050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+44:11554:x1869752792340864:12345-192.168.201.60@tcp:35:lfs.0 00000004:00010000:3.0:1783135510.100695:0:5798:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875d6be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12111 expref: 44 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783135510.101057:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1783135510.101104:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1783135510.101438:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1783135510.101493:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.101511:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.101520:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.101556:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 48 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.101583:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 48 pid: 5796 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135510.101598:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c61f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1869752813303040:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135510.101679:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135510.107933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.108164:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c61f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5798:1869752813303040:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135510.108193:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135510.110300:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792340992 00000100:00100000:0.0:1783135510.110537:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792340992 00010000:00010000:0.0:1783135510.110811:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 49 pid: 5796 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135510.111074:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 77 00000100:00100000:0.0:1783135510.111088:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+49:2360:x1869752792340992:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135510.111104:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135510.111111:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 49 pid: 5796 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.111134:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 49 pid: 5796 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.111159:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d678 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120ee expref: 49 pid: 5796 timeout: 509 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.111174:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135510.111179:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.111187:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.111195:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.111226:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135510.111318:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c61180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+48:2360:x1869752792340992:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 233us (3396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135510.111333:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 77 00010000:00010000:1.0:1783135510.111546:0:5798:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.111554:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135510.112964:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1783135510.113533:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1783135510.113946:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d870e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869752813303168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783135510.114073:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135510.114169:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0133a480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135510.116255:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813303168 00000100:00100000:3.0:1783135510.116270:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813303168 00000100:00080000:1.0:1783135510.116469:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135510.116540:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135510.116553:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1869752813303168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783135510.116803:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5798:x1869752813303168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 252us (2730us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135510.116837:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135510.117054:0:5798:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1783135510.117062:0:5798:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1783135510.117084:0:5798:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f3b9dc700, transno 4294967307 00000100:00100000:1.0:1783135510.117199:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d870e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869752813303168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783135510.118039:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1783135510.118422:0:5798:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d870e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869752813303296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783135510.118499:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135510.118576:0:5798:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052c0480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135510.119187:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813303296 00000100:00100000:2.0:1783135510.119195:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813303296 00000100:00100000:2.0:1783135510.119474:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783135510.119486:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5798:x1869752813303296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1783135510.119729:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5798:x1869752813303296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 246us (1229us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1783135510.119737:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135510.119842:0:5798:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d870e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5798:1869752813303296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783135510.119910:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1783135510.119954:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.119964:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.119971:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.119976:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135510.119981:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.119987:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.120004:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:1.0:1783135510.120007:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783135510.120013:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.120019:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d6d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783135510.120254:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783135510.120358:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1783135510.120370:0:5798:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 409549553381ns, next at 410549551476ns, rc = 0 00000001:00080000:1.0:1783135510.120382:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1783135510.120415:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154f00) 00010000:00010000:1.0:1783135510.120419:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783135510.120426:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875d6be lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12111 expref: 52 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135510.120530:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26327050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+51:11554:x1869752792340864:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 19916us (20254us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1783135510.120539:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 56 00000020:00080000:1.0:1783135510.120543:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783135510.126457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.126556:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792341120 00000100:00100000:0.0:1783135510.126582:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792341120 00000100:00100000:0.0:1783135510.126643:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 203 00000100:00100000:0.0:1783135510.126655:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+51:11554:x1869752792341120:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135510.126797:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135510.127112:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d6da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12118 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.127628:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d6da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12118 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.127644:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d6da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12118 expref: 52 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.127738:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135510.127743:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135510.127746:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043e00, rc 0) 00000100:00100000:1.0:1783135510.127896:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+52:11554:x1869752792341120:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1243us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135510.127905:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 203 00000100:00100000:0.0:1783135510.136354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.136629:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792341376 00000100:00100000:1.0:1783135510.136639:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792341376 00000100:00100000:1.0:1783135510.136725:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:1.0:1783135510.136735:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+52:11554:x1869752792341376:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1783135510.137037:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+53:11554:x1869752792341376:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 303us (691us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1783135510.137046:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 57 00000100:00100000:2.0:1783135510.241163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135510.241449:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792341504 00000100:00100000:3.0:1783135510.241459:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792341504 00000100:00100000:3.0:1783135510.241521:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 204 00000100:00100000:3.0:1783135510.241533:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+53:11564:x1869752792341504:12345-192.168.201.60@tcp:34:lfs.0 00010000:00010000:3.0:1783135510.241616:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241634:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241645:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241674:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241694:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241702:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241860:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241870:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241878:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783135510.241929:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241942:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241949:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241956:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241962:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135510.241966:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241974:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.241995:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:3.0:1783135510.241999:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135510.242003:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242009:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d6e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242037:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242044:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242050:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242055:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135510.242057:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242063:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242070:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f08840b00) 00010000:00010000:3.0:1783135510.242072:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135510.242075:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242080:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d6e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242108:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242468:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242474:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242478:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135510.242481:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242487:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242495:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135510.242497:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135510.242500:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.242505:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d6ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135510.242669:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10532680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+53:11564:x1869752792341504:12345-192.168.201.60@tcp:34:lfs.0 Request processed in 1134us (1512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135510.242679:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 204 00000100:00100000:2.0:1783135510.319032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.319369:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792341760 00000100:00100000:1.0:1783135510.319380:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792341760 00000100:00100000:1.0:1783135510.319442:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 205 00000100:00100000:1.0:1783135510.319453:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+53:11567:x1869752792341760:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135510.319480:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135510.319507:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d6f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1211f expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319588:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319617:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319629:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319644:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319662:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319670:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319891:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d70b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319900:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.319908:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d70b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135510.319918:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783135510.320033:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320041:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320048:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320054:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135510.320059:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320066:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320080:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135510.320083:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135510.320088:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320105:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d6fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320120:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320126:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320131:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320135:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135510.320138:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320143:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320151:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f10923d00) 00010000:00010000:1.0:1783135510.320153:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135510.320156:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320163:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d704 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320483:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d6f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1211f expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320500:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d70b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1211f expref: 55 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.320515:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135510.320518:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135510.320520:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121da00, rc 0) 00000100:00100000:1.0:1783135510.320598:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d854e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+55:11567:x1869752792341760:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1146us (1590us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1783135510.320606:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 205 00000100:00100000:3.0:1783135510.327793:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.328036:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792341888 00000100:00100000:2.0:1783135510.328060:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792341888 00000100:00100000:2.0:1783135510.328131:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 206 00000100:00100000:2.0:1783135510.328141:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+55:11567:x1869752792341888:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:2.0:1783135510.328252:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328271:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328284:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328313:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328331:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328338:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328344:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135510.328349:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328357:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328369:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:2.0:1783135510.328372:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135510.328376:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.328392:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39600/0xf646e0cda875d719 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135510.328907:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+55:11567:x1869752792341888:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 764us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135510.328915:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 206 00000100:00100000:2.0:1783135510.337502:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.337674:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792342144 00000100:00100000:1.0:1783135510.337685:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792342144 00000100:00100000:1.0:1783135510.337748:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 58 00000100:00100000:1.0:1783135510.337760:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+55:11567:x1869752792342144:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:1.0:1783135510.338060:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+56:11567:x1869752792342144:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 302us (571us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1783135510.338068:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 58 00000100:00100000:3.0:1783135510.452553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.452890:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792342400 00000100:00100000:1.0:1783135510.452900:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792342400 00000100:00100000:1.0:1783135510.452963:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 207 00000100:00100000:1.0:1783135510.452972:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+56:11577:x1869752792342400:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1783135510.452997:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135510.453000:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783135510.453060:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875d69b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12103 expref: 56 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.453079:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135510.453084:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783135510.453118:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d720 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12126 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.453230:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.453243:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.453254:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135510.453265:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783135510.453396:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d720 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12126 expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.453413:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12126 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.453420:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135510.453423:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135510.453425:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c400, rc 0) 00000100:00100000:1.0:1783135510.453560:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+57:11577:x1869752792342400:12345-192.168.201.60@tcp:101:bash.0 Request processed in 587us (1015us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1783135510.453569:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 207 00010000:00010000:1.0:1783135510.459037:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135510.469745:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135510.469860:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792342528 00000100:00100000:3.0:1783135510.469870:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792342528 00000100:00100000:3.0:1783135510.469946:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:3.0:1783135510.469956:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+57:2362:x1869752792342528:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135510.469988:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135510.470024:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12126 expref: 57 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.470045:0:5780:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135510.470049:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135510.470116:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+56:2362:x1869752792342528:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 161us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135510.470124:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:2.0:1783135510.474089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.474308:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792342784 00000100:00100000:0.0:1783135510.474319:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792342784 00000100:00100000:0.0:1783135510.474412:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 208 00000100:00100000:0.0:1783135510.474422:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+56:11577:x1869752792342784:12345-192.168.201.60@tcp:36:bash.0 00010000:00010000:0.0:1783135510.474486:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135510.474514:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d70b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1211f expref: 56 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.474534:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135510.474539:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135510.474775:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.474789:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.474799:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135510.474900:0:9499:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1783135510.474941:0:9499:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001963110e reply state 00000000e3db4fba transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135510.474949:0:9499:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135510.475062:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+58:11577:x1869752792342784:12345-192.168.201.60@tcp:36:bash.0 Request processed in 640us (983us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1783135510.475070:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 208 00000020:00080000:0.0:1783135510.475075:0:9499:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135510.478101:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.478194:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.478201:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.478207:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135510.478213:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.478222:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.478245:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135510.478248:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135510.478253:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.478283:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875d735 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135510.482153:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.482420:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792342912 00000100:00100000:1.0:1783135510.482431:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792342912 00000100:00100000:1.0:1783135510.482498:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 209 00000100:00100000:1.0:1783135510.482509:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+57:11577:x1869752792342912:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:1.0:1783135510.482550:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135510.482572:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d73c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1212d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.482654:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.482669:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.482680:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135510.482707:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783135510.482711:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135510.482740:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.482767:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d73c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 59 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.482788:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 58 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.482798:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135510.482801:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135510.482805:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d400, rc 0) 00000100:00100000:1.0:1783135510.482905:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+58:11577:x1869752792342912:12345-192.168.201.60@tcp:101:bash.0 Request processed in 397us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135510.482912:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 209 00000100:00100000:0.0:1783135510.488101:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.488205:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792343168 00000100:00100000:1.0:1783135510.488216:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792343168 00000100:00100000:1.0:1783135510.488278:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 59 00000100:00100000:1.0:1783135510.488289:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+58:11577:x1869752792343168:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:1.0:1783135510.488561:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+59:11577:x1869752792343168:12345-192.168.201.60@tcp:35:bash.0 Request processed in 273us (469us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1783135510.488569:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 59 00000100:00100000:0.0:1783135510.623391:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.623575:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792343296 00000100:00100000:2.0:1783135510.623586:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792343296 00000100:00100000:2.0:1783135510.623649:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 210 00000100:00100000:2.0:1783135510.623660:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+59:11583:x1869752792343296:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135510.623687:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135510.623710:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d74a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12134 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.623776:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d751 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.623791:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.623804:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135510.623895:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1783135510.623899:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135510.623942:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d751 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.623966:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38200/0xf646e0cda875d74a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12134 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.623980:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d751 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12134 expref: 60 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.623986:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:2.0:1783135510.623989:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135510.623991:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c39800, rc 0) 00000100:00100000:2.0:1783135510.624121:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+60:11583:x1869752792343296:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 462us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135510.624129:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 210 00000100:00100000:2.0:1783135510.628098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.628563:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792343424 00000100:00100000:1.0:1783135510.628574:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792343424 00000100:00100000:1.0:1783135510.628682:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 211 00000100:00100000:1.0:1783135510.628693:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+60:11583:x1869752792343424:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135510.628713:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135510.628744:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d758 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1213b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.628809:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.628858:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.628870:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.628886:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.628893:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.628921:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629039:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d76d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629048:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629056:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135510.629095:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1783135510.629099:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135510.629128:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629141:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d76d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629150:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629156:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629163:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629169:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135510.629173:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629188:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629200:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:1.0:1783135510.629203:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135510.629208:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629214:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d75f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629230:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629235:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629241:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629246:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135510.629248:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629254:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629260:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f10923d00) 00010000:00010000:1.0:1783135510.629263:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135510.629265:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629279:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d766 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629327:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ce00/0xf646e0cda875d758 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1213b expref: 62 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629341:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d76d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1213b expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.629348:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135510.629351:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135510.629354:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121ca00, rc 0) 00000100:00100000:1.0:1783135510.629428:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+61:11583:x1869752792343424:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 736us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135510.629436:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 211 00000100:00100000:0.0:1783135510.643277:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.643588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.643638:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792343552 00000100:00100000:0.0:1783135510.643646:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792343552 00000100:00100000:0.0:1783135510.643709:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:0.0:1783135510.643717:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+61:2361:x1869752792343552:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135510.644225:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135510.644257:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121ca00/0xf646e0cda875d76d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1213b expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.644283:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135510.644288:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135510.644430:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+60:2361:x1869752792343552:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 712us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135510.644438:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:3.0:1783135510.644486:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792343808 00000100:00100000:3.0:1783135510.644494:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792343808 00000100:00100000:3.0:1783135510.644533:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 212 00000100:00100000:3.0:1783135510.644542:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+60:11583:x1869752792343808:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135510.644560:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135510.644578:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d774 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12142 expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.644699:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.644715:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.644724:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.644756:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 61 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.644769:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 61 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135510.644783:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c62680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813303424:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135510.644873:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135510.657354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.657553:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792343936 00000100:00100000:2.0:1783135510.657565:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792343936 00010000:00010000:2.0:1783135510.657608:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 62 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135510.657654:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 78 00000100:00100000:2.0:1783135510.657664:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d871180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+62:2360:x1869752792343936:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135510.657681:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135510.657688:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 62 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.657702:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 62 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.657746:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:2.0:1783135510.657752:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.657762:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.657769:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.657788:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135510.657887:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d871180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+62:2360:x1869752792343936:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 223us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135510.657894:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 78 00010000:00010000:3.0:1783135510.660998:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875d743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1212d expref: 61 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135510.661042:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c62680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813303424:192.168.201.60@tcp:104: 00010000:00010000:3.0:1783135510.661067:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.661077:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.661084:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135510.661117:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783135510.661305:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d774 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 62 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.661334:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 61 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.661344:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135510.661347:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783135510.661350:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486a00, rc 0) 00000100:00100000:3.0:1783135510.661432:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+61:11583:x1869752792343808:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 16890us (17843us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1783135510.661442:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 212 00000100:00100000:1.0:1783135510.671611:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.671777:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792344192 00000100:00100000:2.0:1783135510.671789:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792344192 00000100:00100000:2.0:1783135510.672496:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:2.0:1783135510.672512:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d872d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+61:11583:x1869752792344192:12345-192.168.201.60@tcp:103:lfs.0 00010000:00010000:2.0:1783135510.672531:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135510.672562:0:5781:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d6da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12118 expref: 61 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.672586:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:2.0:1783135510.672591:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135510.672663:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d872d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+60:11583:x1869752792344192:12345-192.168.201.60@tcp:103:lfs.0 Request processed in 156us (1068us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135510.672671:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:2.0:1783135510.679636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135510.679702:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792344320 00000100:00100000:3.0:1783135510.679712:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792344320 00000100:00100000:3.0:1783135510.679775:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 213 00000100:00100000:3.0:1783135510.679800:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+60:11583:x1869752792344320:12345-192.168.201.60@tcp:58:lfs.0 00010000:00010000:3.0:1783135510.679955:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.679971:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.679981:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135510.680217:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1783135510.680330:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+60:11583:x1869752792344320:12345-192.168.201.60@tcp:58:lfs.0 Request processed in 529us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135510.680338:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 213 00000100:00100000:3.0:1783135510.686033:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.686136:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792344448 00000100:00100000:0.0:1783135510.686148:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792344448 00000100:00100000:0.0:1783135510.686210:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 214 00000100:00100000:0.0:1783135510.686220:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+60:11583:x1869752792344448:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135510.686255:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135510.686276:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12149 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.686344:0:9499:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.686356:0:9499:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12149 expref: 61 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.686375:0:9499:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.686389:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12149 expref: 61 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.686402:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135510.686405:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135510.686409:0:9499:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12149 expref: 61 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.686416:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043200, rc 0) 00000100:00100000:0.0:1783135510.686473:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+61:11583:x1869752792344448:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 254us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135510.686480:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 214 00000040:00080000:3.0:1783135510.842186:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135510.842324:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135510.842370:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1783135510.842378:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783135510.842502:0:11538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c63100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813303552:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135510.842611:0:11538:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8300 going to sleep for 11 seconds 00000100:00100000:3.0:1783135510.849362:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.849481:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792344576 00000100:00100000:0.0:1783135510.849490:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792344576 00000100:00100000:0.0:1783135510.849556:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 215 00000100:00100000:0.0:1783135510.849580:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+62:11584:x1869752792344576:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135510.849628:0:5796:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783135510.849631:0:11538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c63100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813303552:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783135510.849741:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+61:11584:x1869752792344576:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 164us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135510.849748:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 215 00000100:00100000:0.0:1783135510.859023:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135510.859115:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792344704 00000100:00100000:3.0:1783135510.859125:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792344704 00000100:00100000:3.0:1783135510.859190:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 216 00000100:00100000:3.0:1783135510.859200:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+61:11584:x1869752792344704:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783135510.859275:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859307:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859326:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859343:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859350:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859356:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859380:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859388:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859393:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135510.859442:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783135510.859446:0:9499:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135510.859458:0:9499:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859469:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859485:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859493:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859499:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135510.859503:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859510:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859522:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:3.0:1783135510.859525:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135510.859530:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859536:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d797 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859549:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859554:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859559:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859564:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135510.859572:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859578:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859585:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8e8f08840b00) 00010000:00010000:3.0:1783135510.859588:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135510.859591:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859596:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d79e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859609:0:9499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859615:0:9499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859620:0:9499:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859624:0:9499:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135510.859627:0:9499:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859632:0:9499:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859637:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135510.859639:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135510.859649:0:9499:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.859654:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135510.860184:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+61:11584:x1869752792344704:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 Request processed in 982us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135510.860194:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 216 00000100:00100000:3.0:1783135510.877623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.878045:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792344960 00000100:00100000:0.0:1783135510.878056:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792344960 00000100:00100000:0.0:1783135510.878236:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 217 00000100:00100000:0.0:1783135510.878248:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+61:11584:x1869752792344960:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135510.878269:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135510.878293:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d7ac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12150 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878409:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878426:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878437:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135510.878447:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783135510.878549:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878557:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878581:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878587:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135510.878591:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878597:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878608:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135510.878612:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135510.878616:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878622:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878661:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d7ac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12150 expref: 63 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878670:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:0.0:1783135510.878672:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135510.878675:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043e00/0xf646e0cda875d7ac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12150 expref: 63 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.878684:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043e00, rc 0) 00000100:00100000:0.0:1783135510.878747:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+62:11584:x1869752792344960:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 502us (1145us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1783135510.878763:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 217 00000100:00100000:3.0:1783135510.881941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135510.887627:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792345088 00000100:00100000:2.0:1783135510.887642:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792345088 00000100:00100000:2.0:1783135510.887704:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 218 00000100:00100000:2.0:1783135510.887714:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+62:11584:x1869752792345088:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135510.887750:0:5794:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135510.889178:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+62:11584:x1869752792345088:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 1457us (7240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135510.889191:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 218 00000100:00100000:1.0:1783135510.903995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135510.904165:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792345344 00000100:00100000:3.0:1783135510.904176:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792345344 00000100:00100000:3.0:1783135510.904254:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 219 00000100:00100000:3.0:1783135510.904265:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+62:11584:x1869752792345344:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135510.904290:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135510.904294:0:9499:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783135510.904334:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39800/0xf646e0cda875d751 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12134 expref: 62 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.904355:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:3.0:1783135510.904360:0:9499:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783135510.904373:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12157 expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783135510.904800:0:9499:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:3.0:1783135510.905138:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d7c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.905171:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.905181:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d7c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.905240:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12157 expref: 64 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.905258:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d7c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12157 expref: 63 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.905266:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840b00) 00010000:00010000:3.0:1783135510.905268:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783135510.905271:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486400, rc 0) 00000100:00100000:3.0:1783135510.905327:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+63:11584:x1869752792345344:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 1064us (1343us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1783135510.905334:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 219 00000100:00100000:3.0:1783135510.912416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.912570:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792345600 00000100:00100000:0.0:1783135510.912580:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792345600 00000100:00100000:0.0:1783135510.912637:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 220 00000100:00100000:0.0:1783135510.912647:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+63:11584:x1869752792345600:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135510.912701:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135510.912728:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d7c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12157 expref: 63 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.912747:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840b00) 00010000:00010000:0.0:1783135510.912757:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135510.912778:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.912791:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.912801:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.912872:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.912881:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.912888:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913021:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913030:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913037:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913043:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135510.913048:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913056:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913064:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135510.913068:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135510.913072:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913079:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913089:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913095:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913334:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913346:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135510.913349:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913356:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913364:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x62dbaa8e (ffff8e8f1a154100) 00010000:00010000:0.0:1783135510.913366:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135510.913369:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.913375:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875d7dd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x62dbaa8e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135510.913466:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+62:11584:x1869752792345600:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 819us (1063us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135510.913474:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 220 00000100:00100000:0.0:1783135510.922562:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135510.922637:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792345728 00000100:00100000:3.0:1783135510.922649:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792345728 00000100:00100000:3.0:1783135510.922762:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 221 00000100:00100000:3.0:1783135510.922773:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+62:11584:x1869752792345728:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135510.922794:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135510.922861:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1215e expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.922917:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.922932:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.922956:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.923063:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d7e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 64 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.923081:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 63 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135510.923090:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:3.0:1783135510.923094:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135510.923106:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486200, rc 0) 00000100:00100000:3.0:1783135510.923172:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+63:11584:x1869752792345728:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 401us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135510.923179:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 221 00000100:00100000:2.0:1783135510.929404:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135510.929562:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792345984 00000100:00100000:0.0:1783135510.929571:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792345984 00000100:00100000:0.0:1783135510.929633:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 222 00000100:00100000:0.0:1783135510.929644:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+63:11584:x1869752792345984:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135510.929724:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.929741:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135510.929771:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135510.930397:0:5796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1783135510.930409:0:5796:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410359593089ns, next at 411359590383ns, rc = 0 00000004:00010000:0.0:1783135510.930492:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003992feda reply state 0000000030c95b04 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135510.930502:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135510.930600:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+65:11584:x1869752792345984:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 956us (1205us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1783135510.930608:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 222 00010000:00010000:2.0:1783135510.934448:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.934467:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.934475:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.934481:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135510.934485:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.934492:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.934511:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:2.0:1783135510.934514:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783135510.934518:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135510.934559:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875d7f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135510.950254:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.950528:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792346112 00000100:00100000:1.0:1783135510.950538:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792346112 00000100:00100000:1.0:1783135510.950593:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 223 00000100:00100000:1.0:1783135510.950603:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+64:11584:x1869752792346112:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135510.950628:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135510.950650:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12165 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.950724:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 65 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.950739:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 65 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135510.950758:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:1.0:1783135510.950761:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135510.950764:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d000, rc 0) 00000100:00100000:1.0:1783135510.950881:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+65:11584:x1869752792346112:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 278us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135510.950887:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 223 00000100:00100000:0.0:1783135510.971492:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135510.971617:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792346240 00000100:00100000:3.0:1783135510.971627:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792346240 00000100:00100000:3.0:1783135510.971682:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 62 00000100:00100000:3.0:1783135510.971692:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792346240:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783135510.972120:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+10:2360:x1869752792346240:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 427us (636us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1783135510.972147:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 62 00000100:00100000:0.0:1783135510.982771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135510.982986:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792346496 00000100:00100000:1.0:1783135510.982997:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792346496 00000100:00100000:1.0:1783135510.983070:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 60 00000100:00100000:1.0:1783135510.983081:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+65:11584:x1869752792346496:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135510.983371:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+66:11584:x1869752792346496:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 292us (608us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783135510.983379:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 60 00000100:00100000:2.0:1783135510.995449:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135511.006631:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792346752 00000100:00100000:3.0:1783135511.006648:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792346752 00000100:00100000:3.0:1783135511.006724:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 224 00000100:00100000:3.0:1783135511.006736:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+66:11584:x1869752792346752:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00080000:1.0:1783135511.007083:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135511.009575:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+66:11584:x1869752792346752:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 2829us (14123us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.009588:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 224 00000100:00100000:0.0:1783135511.013312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135511.013465:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792346880 00000100:00100000:1.0:1783135511.013474:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792346880 00000100:00100000:1.0:1783135511.013536:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 225 00000100:00100000:1.0:1783135511.013546:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+66:11584:x1869752792346880:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135511.013566:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135511.013602:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1216c expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.013676:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d807 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.013689:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.013700:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135511.013736:0:5794:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135511.013754:0:5794:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d807 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.013779:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c000/0xf646e0cda875d800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1216c expref: 68 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.013801:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d807 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1216c expref: 67 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.013809:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:1.0:1783135511.013812:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783135511.013895:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121de00, rc 0) 00000100:00100000:1.0:1783135511.013951:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+67:11584:x1869752792346880:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 405us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135511.013958:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 225 00000100:00100000:3.0:1783135511.027389:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135511.027543:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792347008 00000100:00100000:1.0:1783135511.027553:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792347008 00000100:00100000:1.0:1783135511.027643:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 63 00000100:00100000:1.0:1783135511.027653:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+10:2361:x1869752792347008:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135511.027672:0:6590:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135511.027691:0:6590:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12173 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135511.027730:0:6590:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487d16, blocks: 0x1 00010000:00010000:1.0:1783135511.027748:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=410s v=(0 0) 00010000:00010000:1.0:1783135511.027752:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135511.027762:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.027781:0:6590:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 11 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.027794:0:6590:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c000, rc 0) 00000100:00100000:1.0:1783135511.027888:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+11:2361:x1869752792347008:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 236us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135511.027895:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 63 00000100:00080000:2.0:1783135511.027956:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135511.042203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135511.047095:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792347264 00000100:00100000:3.0:1783135511.047111:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792347264 00000100:00100000:2.0:1783135511.047268:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 226 00000100:00100000:2.0:1783135511.047281:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+67:11584:x1869752792347264:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135511.047406:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+67:11584:x1869752792347264:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 127us (5214us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135511.047414:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 226 00000100:00100000:0.0:1783135511.051989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135511.055969:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792347392 00000100:00100000:3.0:1783135511.055985:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792347392 00000100:00100000:2.0:1783135511.059512:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00100000:2.0:1783135511.059527:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+11:11584:x1869752792347392:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783135511.059544:0:6587:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135511.059562:0:6587:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1217a expref: -99 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.059599:0:6587:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.059607:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135511.059611:0:6587:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135511.059616:0:6587:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 12 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.059684:0:6587:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 12 pid: 6590 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.059698:0:6587:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 12 pid: 6590 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.059722:0:6587:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1869752813303680:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135511.059869:0:6587:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4000 going to sleep for 11 seconds 00000100:00100000:3.0:1783135511.068142:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135511.068343:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792347520 00000100:00100000:1.0:1783135511.068353:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792347520 00010000:00010000:1.0:1783135511.068397:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 13 pid: 6590 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135511.068439:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:1.0:1783135511.068448:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+13:2360:x1869752792347520:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135511.068477:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135511.068498:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 13 pid: 6590 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.068512:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 13 pid: 6590 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.068536:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135511.068541:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135511.068548:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 13 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.068558:0:11521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 13 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.068595:0:11521:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 13 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135511.068609:0:11521:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d872680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11521:1869752813303808:192.168.201.60@tcp:105: 00000100:00100000:1.0:1783135511.068690:0:11521:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f0133a480 going to sleep for 11 seconds 00010000:00010000:2.0:1783135511.072903:0:6587:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c04aa886/0xf646e0cda875d80e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12173 expref: 13 pid: 6590 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.072930:0:6587:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6587:1869752813303680:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135511.072959:0:6587:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 12 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.072973:0:6587:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38600, rc 0) 00000100:00100000:2.0:1783135511.073037:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d665850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+12:11584:x1869752792347392:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 13513us (21059us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135511.073047:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00100000:1.0:1783135511.073261:0:11521:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d872680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11521:1869752813303808:192.168.201.60@tcp:105: 00010000:00010000:1.0:1783135511.073273:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135511.073297:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02ce0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+11:2360:x1869752792347520:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4850us (5166us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135511.073319:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:1.0:1783135511.082681:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135511.082838:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792347648 00000100:00100000:0.0:1783135511.082848:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792347648 00002000:00100000:0.0:1783135511.082897:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8e8f3d871180 x1869752792347648/t0(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:682/0 lens 504/0 e 0 to 0 dl 1783135522 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783135511.082909:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3d871180 with x1869752792347648 ext(0->12) 00002000:00010000:0.0:1783135511.082915:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3d871180 00000100:00100000:0.0:1783135511.082946:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:0.0:1783135511.082968:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c7819a6-778a-4617-af33-00460db74182+11:2360:x1869752792347648:12345-192.168.201.60@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783135511.083877:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d871180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0c7819a6-778a-4617-af33-00460db74182+13:2360:x1869752792347648:12345-192.168.201.60@tcp:4:lhsmtool_posix.0 Request processed in 906us (1201us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1783135511.083888:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 6 00002000:00100000:1.0:1783135511.083898:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8e8f3d871180 x1869752792347648/t4294967320(0) o4->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:682/0 lens 504/448 e 0 to 0 dl 1783135522 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783135511.083907:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f3d871180 with x1869752792347648 ext(0->12) 00002000:00010000:1.0:1783135511.083912:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f3d871180 00000100:00100000:3.0:1783135511.092728:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135511.092806:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792347776 00000100:00100000:2.0:1783135511.092834:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792347776 00000100:00100000:2.0:1783135511.092891:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 227 00000100:00100000:2.0:1783135511.092902:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+67:11584:x1869752792347776:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1783135511.154800:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1783135511.154813:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000001:00080000:0.0:1783135511.154871:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1783135511.154887:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1783135511.154906:0:5817:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8f052c0600 refcount 2 committed 0 result 0 batchid 7 00000100:00100000:2.0:1783135511.154907:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+47:11584:x1869752792347776:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 Request processed in 62000us (62181us total) trans 0 rc 0/0 00000020:00080000:0.0:1783135511.154910:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f3d04e800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f052c0d80 00000020:00080000:0.0:1783135511.154914:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f3d04e900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f3d914000 00000100:00100000:2.0:1783135511.154918:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 227 00000004:00080000:0.0:1783135511.154938:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1783135511.154946:0:5817:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1783135511.154994:0:5817:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8f3cbb80c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1783135511.154997:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f3c8a8100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f3cbb8c00 00000020:00080000:0.0:1783135511.154999:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f3c8a8600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f3d903c00 00000100:00100000:3.0:1783135511.155159:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813304192:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1783135511.155225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135511.155268:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135511.155274:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813304064:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783135511.155296:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135511.155322:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813304192 00000100:00100000:3.0:1783135511.155327:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813304192 00000100:00100000:3.0:1783135511.155367:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813304064 00000100:00100000:3.0:1783135511.155370:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813304064 00000100:00100000:3.0:1783135511.155386:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135511.155394:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1869752813304192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1783135511.155536:0:6590:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783135511.155540:0:6590:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783135510 00002000:00010000:3.0:1783135511.155542:0:6590:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783135511.155544:0:6590:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783135510 -> 1783135510 00002000:00010000:3.0:1783135511.155558:0:6590:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783135511.155590:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3312:x1869752813304192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 196us (365us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1783135511.155596:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135511.155609:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783135511.155615:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1869752813304064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783135511.155627:0:6590:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1783135511.155643:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.155661:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.155670:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1783135511.155674:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135511.155678:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.155703:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 12 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.155781:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 12 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135511.155795:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813304320:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135511.155853:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cbb8300 going to sleep for 11 seconds 00000100:00080000:3.0:1783135511.155876:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783135511.155909:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f02c60700/2, rc 0, transno 4294967321 00000100:00100000:3.0:1783135511.155915:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813304192:0@lo:2:osp-syn-0-0.0 00000020:00080000:0.0:1783135511.158103:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1783135511.158357:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1783135511.158719:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813303936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1783135511.158793:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135511.159031:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813303936 00000100:00100000:0.0:1783135511.159040:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813303936 00000100:00100000:0.0:1783135511.159094:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783135511.159110:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1869752813303936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1783135511.159138:0:8303:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:0.0:1783135511.159174:0:8303:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a487d15, atime: 0x6a487d15, ctime: 0x6a487d15, blocks: 0x1 00010000:00010000:0.0:1783135511.159182:0:8303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.159197:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1783135511.159201:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135511.159221:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.159238:0:8303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.159249:0:8303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.159257:0:8303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.159339:0:8303:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783135511.159962:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813303936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 852us (1167us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1783135511.159973:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:0.0:1783135511.160136:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f02c72680/2, rc 0, transno 4294967310 00000100:00100000:0.0:1783135511.160144:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813303936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783135511.161711:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135511.162067:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792347904 00000100:00100000:2.0:1783135511.162080:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792347904 00000100:00100000:2.0:1783135511.162143:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 68 00000100:00100000:2.0:1783135511.162153:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+13:2361:x1869752792347904:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783135511.164768:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135511.164797:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813304448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783135511.164919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135511.165040:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813304448 00000100:00100000:2.0:1783135511.165049:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813304448 00000100:00100000:2.0:1783135511.165116:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1783135511.165126:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813304448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135511.165155:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135511.165206:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813304448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135511.165214:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:1.0:1783135511.165378:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135511.165390:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.165404:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135511.165410:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.165421:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.165442:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.165449:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be853a65/0xf646e0cda875d823 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.165474:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135511.165492:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135511.165494:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135511.165697:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813304448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135511.178169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135511.178443:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c61180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813304320:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135511.178473:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.178907:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792348032 00000100:00100000:2.0:1783135511.178916:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792348032 00010000:00010000:2.0:1783135511.178958:0:5780:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 14 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.179014:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 80 00000100:00100000:2.0:1783135511.179025:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+14:2360:x1869752792348032:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135511.179043:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135511.179056:0:5780:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 14 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.179070:0:5780:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 14 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.179101:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f65681a7/0xf646e0cda875d5de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120d9 expref: 14 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.179122:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135511.179127:0:5780:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135511.179134:0:5780:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.179145:0:5780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.179170:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135511.179243:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0c7819a6-778a-4617-af33-00460db74182+13:2360:x1869752792348032:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 219us (1082us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135511.179251:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 80 00010000:00010000:0.0:1783135511.181030:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.181050:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.181062:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.181071:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.181230:0:6590:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783135511.181913:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3312:x1869752813304064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 26292us (26609us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1783135511.181925:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:3.0:1783135511.182325:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f02c63b80/2, rc 0, transno 4294967322 00000100:00100000:3.0:1783135511.182334:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813304064:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1783135511.184980:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135511.184997:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.185021:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135511.185028:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.185053:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.185078:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.185086:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001764c049/0xf646e0cda875d81c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.186456:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135511.186463:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135511.186466:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135511.198733:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+12:2361:x1869752792347904:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 Request processed in 36569us (37018us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.198749:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 68 00000001:00080000:1.0:1783135511.198839:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1783135511.198860:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:1.0:1783135511.198870:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:0.0:1783135511.202671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135511.202782:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792348288 00000100:00100000:2.0:1783135511.202793:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792348288 00000100:00100000:2.0:1783135511.202948:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 228 00000100:00100000:2.0:1783135511.202960:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+20:11584:x1869752792348288:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783135511.203029:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135511.203057:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121de00/0xf646e0cda875d807 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1216c expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.203077:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:2.0:1783135511.203082:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135511.203120:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.203134:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.203144:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135511.203544:0:5796:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fce8b695 reply state 000000002e76291d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.203554:0:5796:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783135511.203741:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+21:11584:x1869752792348288:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 782us (1140us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1783135511.203749:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 228 00010000:00010000:1.0:1783135511.206360:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.206378:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.206385:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.206392:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135511.206397:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.206404:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.206422:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:1.0:1783135511.206425:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135511.206429:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.206435:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38a00/0xf646e0cda875d82a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135511.207185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135511.207396:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792348416 00000100:00100000:1.0:1783135511.207406:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792348416 00000100:00100000:1.0:1783135511.207460:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:1.0:1783135511.207469:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792348416:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783135511.207685:0:6587:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783135511.207689:0:6587:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1783135510 -> 1783135510 00002000:00010000:1.0:1783135511.207691:0:6587:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783135509 00002000:00010000:1.0:1783135511.207693:0:6587:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1783135510 -> 1783135510 00002000:00010000:1.0:1783135511.207695:0:6587:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783135511.207749:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792348416:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 280us (568us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783135511.207757:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:3.0:1783135511.210528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135511.211235:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792348672 00000100:00100000:0.0:1783135511.211247:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792348672 00000100:00100000:0.0:1783135511.211320:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 229 00000100:00100000:0.0:1783135511.211332:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+20:11584:x1869752792348672:12345-192.168.201.60@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1783135511.211404:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.211437:0:5795:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.211447:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.211486:0:5795:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.211500:0:5795:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 20 pid: 9499 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135511.211516:0:5795:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c71880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813304576:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135511.212865:0:5795:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05604900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135511.215676:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135511.215708:0:5781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792348800 00000100:00100000:0.0:1783135511.215716:0:5781:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792348800 00010000:00010000:0.0:1783135511.215753:0:5781:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 21 pid: 9499 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135511.215783:0:5781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 81 00000100:00100000:0.0:1783135511.215792:0:5781:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+21:2361:x1869752792348800:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135511.215806:0:5781:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135511.215836:0:5781:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 21 pid: 9499 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.215869:0:5781:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 21 pid: 9499 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.215893:0:5781:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:0.0:1783135511.215899:0:5781:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.215909:0:5781:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.215916:0:5781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.215933:0:5781:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135511.215979:0:5781:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0c7819a6-778a-4617-af33-00460db74182+21:2361:x1869752792348800:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 187us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.215988:0:5781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 81 00010000:00010000:2.0:1783135511.217083:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486200/0xf646e0cda875d7eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1215e expref: 20 pid: 9499 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.217109:0:5795:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c71880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5795:1869752813304576:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135511.217130:0:5795:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217140:0:5795:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217145:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217174:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217181:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217188:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217211:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135511.217216:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217223:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217235:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:2.0:1783135511.217238:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783135511.217242:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.217248:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875d831 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.217315:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+19:11584:x1869752792348672:12345-192.168.201.60@tcp:55:lhsmtool_posix.0 Request processed in 5975us (6785us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783135511.217325:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 229 00000100:00100000:0.0:1783135511.220607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135511.220698:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792348928 00000100:00100000:2.0:1783135511.220708:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792348928 00000100:00100000:2.0:1783135511.220768:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:2.0:1783135511.220778:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792348928:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783135511.220851:0:6590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.220872:0:6590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.220901:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135511.220905:0:6590:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135511.220910:0:6590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.220946:0:6590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 8 pid: 6587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.220959:0:6590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 8 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.220974:0:6590:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813304704:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135511.221066:0:6590:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4480 going to sleep for 11 seconds 00000100:00100000:3.0:1783135511.224570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135511.224687:0:6590:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6590:1869752813304704:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135511.224714:0:6590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135511.229176:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792349056 00000100:00100000:0.0:1783135511.229193:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792349056 00010000:00010000:0.0:1783135511.229242:0:11521:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 9 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135511.229433:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 82 00000100:00100000:0.0:1783135511.229446:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+9:2360:x1869752792349056:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135511.229464:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135511.229486:0:11521:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 9 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.229515:0:11521:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 9 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.229539:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d20ab384/0xf646e0cda875d815 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1217a expref: 9 pid: 6587 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.229557:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135511.229562:0:11521:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783135511.229568:0:11521:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.229578:0:11521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.229619:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135511.229676:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+8:2360:x1869752792349056:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 232us (5116us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.229684:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 82 00010000:00010000:1.0:1783135511.229750:0:6590:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.229762:0:6590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.229787:0:6590:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.229795:0:6590:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.229804:0:6590:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.229811:0:6590:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135511.229843:0:6590:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.229867:0:6590:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.229881:0:6590:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.229889:0:6590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029f6f120/0xf646e0cda875d838 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135511.229938:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+7:2360:x1869752792348928:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 Request processed in 9161us (9342us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135511.229946:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 70 00000100:00100000:0.0:1783135511.233419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135511.233505:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792349312 00000100:00100000:3.0:1783135511.233515:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792349312 00000100:00100000:3.0:1783135511.233608:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 230 00000100:00100000:3.0:1783135511.233619:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+19:11584:x1869752792349312:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783135511.233703:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.233721:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.233733:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.234171:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.234183:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.234198:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.234232:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 20 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.234247:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 20 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135511.234261:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c61180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813304832:192.168.201.60@tcp:104: 00000100:00100000:3.0:1783135511.234472:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f082629c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135511.237926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135511.238077:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c61180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813304832:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135511.238117:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135511.239219:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792349440 00000100:00100000:1.0:1783135511.239229:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792349440 00010000:00010000:1.0:1783135511.239268:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 21 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135511.239318:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 83 00000100:00100000:1.0:1783135511.239327:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+21:2361:x1869752792349440:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135511.239342:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135511.239349:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 21 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.239376:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 21 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.239399:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d7f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12165 expref: 21 pid: 5794 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.239416:0:6604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:1.0:1783135511.239422:0:6604:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.239432:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.239440:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.239466:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135511.239520:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0c7819a6-778a-4617-af33-00460db74182+20:2361:x1869752792349440:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 193us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135511.239528:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 83 00010000:00010000:1.0:1783135511.239551:0:5794:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.239558:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135511.239733:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1783135511.239891:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1783135511.239934:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1783135511.240038:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1869752813304960:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783135511.240087:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135511.240125:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c09c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135511.241622:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813304960 00000100:00100000:3.0:1783135511.241632:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813304960 00000100:00100000:3.0:1783135511.241688:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783135511.241697:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1869752813304960:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1783135511.241790:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d872680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1869752813304960:12345-0@lo:1000:mdt00_000.0 Request processed in 93us (1701us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.241798:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783135511.242230:0:5794:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:1.0:1783135511.242236:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f37c2bb80, transno 4294967315 00000004:00080000:1.0:1783135511.242244:0:5794:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:1.0:1783135511.242260:0:5794:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f02c60700, transno 4294967321 00000100:00100000:1.0:1783135511.242269:0:5794:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff8e8f02c63b80 x1869752813304064/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783135527 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135511.242281:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1869752813304960:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1783135511.243877:0:5794:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1783135511.243959:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1869752813305088:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783135511.244026:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135511.244058:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c09600 going to sleep for 11 seconds 00000100:00100000:2.0:1783135511.244528:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813305088 00000100:00100000:2.0:1783135511.244536:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813305088 00000100:00100000:2.0:1783135511.244586:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783135511.244597:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5794:x1869752813305088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783135511.244801:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5794:x1869752813305088:12345-0@lo:1000:mdt00_000.0 Request processed in 205us (774us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1783135511.244809:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135511.247739:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d872d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5794:1869752813305088:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783135511.247803:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247829:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247838:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247844:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135511.247848:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247856:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247885:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f08840000) 00010000:00010000:1.0:1783135511.247888:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135511.247893:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247900:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487c00/0xf646e0cda875d846 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247932:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247938:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247943:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247949:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135511.247952:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247957:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247964:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135511.247966:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135511.247974:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12149 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.247985:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12149 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.248013:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12149 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.248052:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12149 expref: 23 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135511.248067:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d872300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813305216:192.168.201.60@tcp:105: 00000100:00100000:1.0:1783135511.248169:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c09600 going to sleep for 11 seconds 00000100:00100000:1.0:1783135511.254090:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d872300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5794:1869752813305216:192.168.201.60@tcp:105: 00010000:00010000:1.0:1783135511.254120:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254130:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487a00/0xf646e0cda875d789 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254228:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254246:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254258:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254270:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254276:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254297:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254373:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135511.254377:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254385:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254397:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135511.254400:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135511.254404:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254409:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c200/0xf646e0cda875d84d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254420:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254425:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254430:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254433:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135511.254436:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254452:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254459:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135511.254461:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135511.254464:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.254469:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486800/0xf646e0cda875d83f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135511.254802:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+23:11584:x1869752792349312:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 21183us (21392us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1783135511.254842:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 230 00000020:00080000:1.0:1783135511.254849:0:5794:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1783135511.255188:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135511.255194:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135511.255666:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783135511.255677:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783135511.257389:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135511.257463:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792349568 00000100:00100000:3.0:1783135511.257472:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792349568 00000100:00100000:3.0:1783135511.257555:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:3.0:1783135511.257565:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+23:11583:x1869752792349568:12345-192.168.201.60@tcp:49:lfs.0 00000100:00100000:3.0:1783135511.257677:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+23:11583:x1869752792349568:12345-192.168.201.60@tcp:49:lfs.0 Request processed in 113us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.257704:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 61 00000100:00100000:0.0:1783135511.261470:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135511.261563:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792349824 00000100:00100000:1.0:1783135511.261573:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792349824 00000100:00100000:1.0:1783135511.261625:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 62 00000100:00100000:1.0:1783135511.261634:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26325450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+23:11584:x1869752792349824:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783135511.262763:0:5798:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00100000:3.0:1783135511.267426:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135511.267687:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792350080 00000100:00100000:2.0:1783135511.267697:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792350080 00000100:00100000:2.0:1783135511.267756:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 231 00000100:00100000:2.0:1783135511.267766:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+25:11583:x1869752792350080:12345-192.168.201.60@tcp:58:lfs.0 00000040:00080000:2.0:1783135511.268076:0:5795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1783135511.268170:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+25:11583:x1869752792350080:12345-192.168.201.60@tcp:58:lfs.0 Request processed in 404us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135511.268177:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 231 00000001:00080000:1.0:1783135511.268833:0:5798:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1783135511.269056:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.269074:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.269086:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.269120:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.269128:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.269133:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135511.269157:0:5798:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783135511.269234:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26325450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+25:11584:x1869752792349824:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 7599us (7770us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1783135511.269245:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 62 00000020:00080000:1.0:1783135511.269250:0:5798:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783135511.269440:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135511.269447:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.269454:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d000 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135511.269457:0:6603:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.269465:0:6603:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.269478:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8e8f10923d00) 00010000:00010000:3.0:1783135511.269481:0:6603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783135511.269485:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.269490:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d000/0xf646e0cda875d854 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5798 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.269505:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135511.269507:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135511.269508:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135511.319917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135511.320038:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792350208 00000100:00100000:2.0:1783135511.320048:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792350208 00000100:00100000:2.0:1783135511.320109:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 232 00000100:00100000:2.0:1783135511.320118:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+25:11586:x1869752792350208:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135511.320143:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135511.320165:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d85b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12181 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320230:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320246:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320257:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320288:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320296:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320302:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320737:0:5796:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320749:0:5796:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320757:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320792:0:5796:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 26 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135511.320804:0:5796:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 26 pid: 5795 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135511.320840:0:5796:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813305344:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135511.320915:0:5796:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135511.326288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135511.326451:0:5796:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5796:1869752813305344:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135511.326479:0:5796:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135511.336264:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792350464 00000100:00100000:3.0:1783135511.336278:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792350464 00000100:00100000:0.0:1783135511.336635:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 63 00000100:00100000:0.0:1783135511.336647:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+27:5575:x1869752792350464:12345-192.168.201.60@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783135511.336925:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+28:5575:x1869752792350464:12345-192.168.201.60@tcp:35:ldlm_bl.0 Request processed in 278us (10645us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1783135511.336956:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 63 00000100:00100000:0.0:1783135511.350546:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135511.350762:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792350592 00000100:00100000:3.0:1783135511.350772:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792350592 00010000:00010000:3.0:1783135511.350849:0:5782:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 28 pid: 5795 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135511.350913:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00100000:3.0:1783135511.350924:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+28:2361:x1869752792350592:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135511.350938:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135511.350944:0:5782:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 28 pid: 5795 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.350957:0:5782:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 28 pid: 5795 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.350980:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d77b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12142 expref: 28 pid: 5795 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.350995:0:5782:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135511.351085:0:5782:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.351124:0:5782:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.351131:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135511.351161:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135511.351262:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0c7819a6-778a-4617-af33-00460db74182+27:2361:x1869752792350592:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 339us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135511.351270:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 84 00010000:00010000:0.0:1783135511.352399:0:5796:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352431:0:5796:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135511.352497:0:5796:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1783135511.352502:0:5796:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135511.352535:0:5796:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352549:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352559:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352565:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352572:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352578:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135511.352582:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352589:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352624:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135511.352627:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135511.352632:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352639:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875d862 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352667:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352673:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352678:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352683:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135511.352685:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352691:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352698:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8e8f18315200) 00010000:00010000:0.0:1783135511.352700:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135511.352703:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352709:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875d869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5796 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352760:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39200/0xf646e0cda875d85b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12181 expref: 27 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352776:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12181 expref: 26 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135511.352783:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135511.352785:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135511.352788:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c39a00, rc 0) 00000100:00100000:0.0:1783135511.352882:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0c7819a6-778a-4617-af33-00460db74182+26:11586:x1869752792350208:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 32765us (32974us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135511.352890:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 232 00010000:00010000:1.0:1783135511.482009:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135512.166746:0:12316:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135512.166756:0:12316:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135512.166803:0:12316:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783135512.166812:0:12316:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1783135512.314042:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783135512.314052:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783135512.314104:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783135512.314116:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135512.314240:0:11538:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813305472:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135512.314533:0:11538:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05604900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135512.324557:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135512.324810:0:11538:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11538:1869752813305472:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783135512.326026:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792350720 00000100:00100000:2.0:1783135512.326039:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792350720 00000100:00100000:2.0:1783135512.326100:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 233 00000100:00100000:2.0:1783135512.326110:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+26:11599:x1869752792350720:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783135512.326146:0:5795:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783135512.326259:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d872300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+26:11599:x1869752792350720:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 149us (1711us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135512.326267:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 233 00000100:00100000:3.0:1783135512.330485:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135512.331103:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792350976 00000100:00100000:1.0:1783135512.331115:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792350976 00000100:00100000:1.0:1783135512.331180:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 234 00000100:00100000:1.0:1783135512.331191:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+26:11599:x1869752792350976:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135512.331211:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135512.334614:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d877 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12188 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135512.334752:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d87e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135512.334767:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135512.334791:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d87e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135512.334807:0:5794:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1783135512.334968:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d877 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12188 expref: 29 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135512.337147:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d87e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12188 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135512.337162:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:1.0:1783135512.337165:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783135512.337169:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c400, rc 0) 00000100:00100000:1.0:1783135512.337259:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+28:11599:x1869752792350976:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 6068us (6783us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1783135512.337486:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 234 00000100:00100000:1.0:1783135512.356034:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135512.356269:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792351104 00000100:00100000:0.0:1783135512.356279:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792351104 00000100:00100000:0.0:1783135512.356444:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:0.0:1783135512.356455:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+28:2360:x1869752792351104:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135512.356470:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135512.356494:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d87e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12188 expref: 28 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135512.356510:0:11521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135512.356515:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135512.356565:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d870380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:0c7819a6-778a-4617-af33-00460db74182+27:2360:x1869752792351104:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 113us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135512.356573:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:1.0:1783135512.374233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135512.374661:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792351360 00000100:00100000:3.0:1783135512.374672:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792351360 00000100:00100000:3.0:1783135512.374735:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 235 00000100:00100000:3.0:1783135512.374746:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+27:11599:x1869752792351360:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783135512.374863:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.374891:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.374903:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.375408:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.375419:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.375426:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.375433:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135512.375437:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.375445:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.375457:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135512.375465:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783135512.375470:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135512.375477:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d88c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135512.375683:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+28:11599:x1869752792351360:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 936us (1460us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783135512.375693:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 235 00000040:00080000:0.0:1783135512.377183:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135512.377193:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135512.378247:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1783135512.378259:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783135512.379421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135512.381848:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792351616 00000100:00100000:0.0:1783135512.381865:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792351616 00000100:00100000:0.0:1783135512.381929:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 64 00000100:00100000:0.0:1783135512.381940:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+28:11599:x1869752792351616:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1783135512.382213:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+29:11599:x1869752792351616:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 273us (2797us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1783135512.382222:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 64 00010000:00010000:3.0:1783135512.506992:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135512.574872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135512.574908:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135512.574941:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135512.575020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135512.575247:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792351872 00000100:00100000:3.0:1783135512.575258:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792351872 00000100:00100000:3.0:1783135512.575322:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792352000 00000100:00100000:3.0:1783135512.575325:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792352000 00000100:00100000:3.0:1783135512.575358:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 91 00000100:00100000:3.0:1783135512.575367:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792351872:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135512.575452:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792351872:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 85us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135512.575460:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 91 00000100:00100000:3.0:1783135512.575479:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 92 00000100:00100000:3.0:1783135512.575486:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2362:x1869752792352000:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135512.575514:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2362:x1869752792352000:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 30us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135512.575520:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 92 00000100:00080000:3.0:1783135512.575535:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783135512.577291:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792351744 00000100:00100000:0.0:1783135512.577303:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792351744 00000100:00100000:0.0:1783135512.577368:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 297 00000100:00100000:0.0:1783135512.577387:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792351744:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135512.577445:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792351744:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 68us (2635us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135512.577453:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 297 00000100:00100000:2.0:1783135512.578995:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792352128 00000100:00100000:2.0:1783135512.579778:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792352128 00000100:00100000:2.0:1783135512.579946:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 161 00000100:00100000:2.0:1783135512.579958:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792352128:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135512.580049:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d872a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792352128:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 93us (5028us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135512.580073:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 161 00000100:00080000:0.0:1783135512.580563:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135513.217478:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135513.217525:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813305600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135513.217650:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135513.217750:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813305600 00000100:00100000:2.0:1783135513.217759:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813305600 00000100:00100000:2.0:1783135513.217855:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135513.217866:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1869752813305600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135513.217906:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135513.217961:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1869752813305600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135513.217978:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783135513.218032:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813305600:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783135513.218278:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783135513.531583:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135513.722534:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813305728:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.722624:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135513.722683:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813306240:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.722713:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135513.722737:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783135513.722743:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813306112:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.722770:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135513.722801:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813305984:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.723308:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135513.723411:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783135513.723420:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813305856:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.723450:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135513.723471:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813306368:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.723494:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135513.723528:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813306112 00000100:00100000:3.0:1783135513.723535:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813306112 00000100:00100000:3.0:1783135513.723581:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813306368 00000100:00100000:3.0:1783135513.723584:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813306368 00000100:00100000:3.0:1783135513.723752:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135513.723761:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1869752813306112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.723846:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1869752813306112:12345-0@lo:400:kworker.0 Request processed in 85us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135513.723853:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783135513.724021:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783135513.724044:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1869752813306368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135513.724172:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813306240 00000100:00100000:1.0:1783135513.724177:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813306240 00000100:00100000:1.0:1783135513.724208:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813305984 00000100:00100000:1.0:1783135513.724211:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813305984 00000100:00100000:1.0:1783135513.724223:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813305856 00000100:00100000:1.0:1783135513.724226:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813305856 00000100:00100000:1.0:1783135513.724248:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783135513.724254:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813306240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135513.724306:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813306240:12345-0@lo:400:kworker.0 Request processed in 52us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135513.724313:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783135513.724326:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783135513.724341:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3cba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813305984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135513.724374:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3cba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813305984:12345-0@lo:400:kworker.0 Request processed in 34us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135513.724380:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783135513.724396:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783135513.724402:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813305856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135513.724427:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813305856:12345-0@lo:400:kworker.0 Request processed in 26us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135513.724432:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1783135513.724761:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3314:x1869752813306368:12345-0@lo:400:kworker.0 Request processed in 717us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135513.724769:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:3.0:1783135513.724801:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135513.724806:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135513.724953:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813305856:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.724981:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813306368:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.724992:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813305984:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.725028:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813306112:0@lo:400:kworker.0 00000100:00100000:3.0:1783135513.725040:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813306240:0@lo:400:kworker.0 00000100:00100000:2.0:1783135513.725163:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813305728 00000100:00100000:2.0:1783135513.725169:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813305728 00000100:00100000:2.0:1783135513.725202:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783135513.725209:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813305728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135513.725249:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813305728:12345-0@lo:400:kworker.0 Request processed in 41us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135513.725256:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783135513.725622:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813305728:0@lo:400:kworker.0 00000001:00080000:0.0:1783135514.415567:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1783135514.415586:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000040:00080000:0.0:1783135514.456156:0:12369:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135514.456168:0:12369:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135514.456216:0:12369:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783135514.456224:0:12369:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783135514.592632:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135514.908602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135514.908711:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792352384 00000100:00100000:3.0:1783135514.908722:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792352384 00000100:00100000:3.0:1783135514.908805:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 236 00000100:00100000:3.0:1783135514.908843:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+29:11619:x1869752792352384:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135514.908870:0:9499:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135514.908890:0:9499:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d893 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1218f expref: -99 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.909010:0:9499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d89a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.909025:0:9499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d89a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.909038:0:9499:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d89a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9499 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135514.909063:0:9499:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783135514.909191:0:9499:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486400/0xf646e0cda875d893 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1218f expref: 32 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.909210:0:9499:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d89a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1218f expref: 31 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.909219:0:9499:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135514.909222:0:9499:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783135514.909225:0:9499:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486a00, rc 0) 00000100:00100000:3.0:1783135514.909287:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d873b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+31:11619:x1869752792352384:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 474us (694us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1783135514.909295:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 236 00000100:00080000:2.0:1783135514.909462:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135514.914219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135514.914313:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792352512 00000100:00100000:3.0:1783135514.914323:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792352512 00000100:00100000:3.0:1783135514.914385:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 237 00000100:00100000:3.0:1783135514.914395:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+31:11619:x1869752792352512:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:3.0:1783135514.914468:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914485:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914497:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914523:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914537:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914544:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914550:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135514.914555:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914561:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914574:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:3.0:1783135514.914577:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783135514.914581:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135514.914587:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487200/0xf646e0cda875d8a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5794 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135514.914659:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0c7819a6-778a-4617-af33-00460db74182+31:11619:x1869752792352512:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 264us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135514.914668:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 237 00000100:00100000:3.0:1783135515.058188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135515.058321:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792352640 00000100:00100000:0.0:1783135515.058331:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792352640 00000100:00100000:0.0:1783135515.058406:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 71 00000100:00100000:0.0:1783135515.058416:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792352640:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:0.0:1783135515.058435:0:8303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135515.058456:0:8303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d7adf8a/0xf646e0cda875d8af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12196 expref: -99 pid: 8303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783135515.058482:0:8303:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a487d16, atime: 0x6a487d15, ctime: 0x6a487d16, blocks: 0xb 00010000:00010000:0.0:1783135515.058502:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:0.0:1783135515.058507:0:8303:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135515.058517:0:8303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d7adf8a/0xf646e0cda875d8af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12196 expref: 8 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135515.058536:0:8303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d7adf8a/0xf646e0cda875d8af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12196 expref: 8 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135515.058549:0:8303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043000, rc 0) 00000100:00100000:0.0:1783135515.058624:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0c7819a6-778a-4617-af33-00460db74182+8:2363:x1869752792352640:12345-192.168.201.60@tcp:101:cat.0 Request processed in 209us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135515.058631:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 71 00000100:00080000:2.0:1783135515.058746:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783135515.063288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135515.063403:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792352768 00000100:00100000:2.0:1783135515.063415:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792352768 00002000:00100000:2.0:1783135515.063464:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8e8f02d13480 x1869752792352768/t0(0) o3->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:686/0 lens 488/0 e 0 to 0 dl 1783135526 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135515.063474:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f02d13480 with x1869752792352768 ext(0->4095) 00002000:00010000:2.0:1783135515.063494:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f02d13480 00000100:00100000:2.0:1783135515.063527:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:2.0:1783135515.063536:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+8:2362:x1869752792352768:12345-192.168.201.60@tcp:3:cat.0 00000100:00100000:2.0:1783135515.063770:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0c7819a6-778a-4617-af33-00460db74182+8:2362:x1869752792352768:12345-192.168.201.60@tcp:3:cat.0 Request processed in 234us (491us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783135515.063778:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00002000:00100000:2.0:1783135515.063785:0:6593:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8e8f02d13480 x1869752792352768/t0(0) o3->0c7819a6-778a-4617-af33-00460db74182@192.168.201.60@tcp:686/0 lens 488/4536 e 0 to 0 dl 1783135526 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783135515.063794:0:6593:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff8e8f02d13480 with x1869752792352768 ext(0->4095) 00002000:00010000:2.0:1783135515.063798:0:6593:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8e8f02d13480 00010000:00010000:3.0:1783135515.580451:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135516.282991:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135516.283013:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813306496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135516.283082:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135516.289683:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813306496 00000100:00100000:2.0:1783135516.289698:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813306496 00000100:00100000:2.0:1783135516.289761:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783135516.289773:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813306496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135516.289856:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135516.290434:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813306496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 662us (7350us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135516.290443:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1783135516.290478:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135516.290523:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1783135516.290529:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1783135516.290548:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f02c72680, transno 4294967310 00000100:00100000:2.0:1783135516.290569:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813306496:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1783135516.417302:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1783135516.417323:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1783135516.417329:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:0.0:1783135516.417660:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1783135516.417673:0:5817:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1783135516.417695:0:5817:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8e8f37c09c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1783135516.417701:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f3d04e200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f37c09840 00000020:00080000:0.0:1783135516.417705:0:5817:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff8e8f3d04ef00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8e8f3c425c00 00000001:00080000:0.0:1783135516.417737:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1783135516.417760:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783135516.418693:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1783135516.604451:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135517.507865:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783135517.507876:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135517.507934:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1783135517.507941:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783135517.626615:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135517.706930:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135517.706985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135517.707013:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135517.707036:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135517.707061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135517.707109:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792353408 00000100:00100000:1.0:1783135517.707118:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792353408 00000100:00100000:1.0:1783135517.707173:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792353024 00000100:00100000:1.0:1783135517.707176:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792353024 00000100:00100000:1.0:1783135517.707214:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 165 00000100:00100000:1.0:1783135517.707225:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792353408:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135517.707305:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2363:x1869752792353408:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 82us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135517.707312:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 165 00000100:00100000:1.0:1783135517.707328:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 166 00000100:00100000:1.0:1783135517.707335:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+18:2363:x1869752792353024:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135517.707360:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d870e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0c7819a6-778a-4617-af33-00460db74182+18:2363:x1869752792353024:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135517.707366:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 166 00000100:00100000:1.0:1783135517.707382:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792353152 00000100:00100000:1.0:1783135517.707385:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792353152 00000100:00100000:1.0:1783135517.707408:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792353280 00000100:00100000:1.0:1783135517.707411:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792353280 00000100:00100000:1.0:1783135517.707429:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 95 00000100:00100000:1.0:1783135517.707436:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792353152:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135517.707459:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d870700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+7:2363:x1869752792353152:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135517.707465:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 95 00000100:00100000:1.0:1783135517.707476:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 96 00000100:00100000:1.0:1783135517.707482:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792353280:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135517.707504:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10b5c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2363:x1869752792353280:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 23us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135517.707517:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 96 00000100:00080000:1.0:1783135517.707535:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135517.707538:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783135517.707540:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135517.708290:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792352896 00000100:00100000:2.0:1783135517.708297:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792352896 00000100:00100000:2.0:1783135517.708347:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 299 00000100:00100000:2.0:1783135517.708356:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792352896:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135517.708409:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2363:x1869752792352896:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 54us (1522us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135517.708416:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 299 00000100:00100000:1.0:1783135518.333429:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813306624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135518.333513:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135518.335185:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813306624 00000100:00100000:2.0:1783135518.335201:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813306624 00000100:00100000:2.0:1783135518.335288:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783135518.335299:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813306624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135518.335340:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135518.335427:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813306624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135518.335435:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783135518.335599:0:3311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1783135518.335605:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f02c63b80, transno 4294967322 00000004:00080000:0.0:1783135518.335623:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1783135518.335651:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813306624:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783135518.337402:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783135518.650614:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135518.842286:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813306880:0@lo:400:kworker.0 00000100:00100000:1.0:1783135518.842358:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135518.842423:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d13ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813307392:0@lo:400:kworker.0 00000100:00100000:1.0:1783135518.842450:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135518.842499:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135518.842505:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d13c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813307008:0@lo:400:kworker.0 00000100:00100000:1.0:1783135518.842525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135518.842555:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813306880 00000100:00100000:1.0:1783135518.842562:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813306880 00000100:00100000:1.0:1783135518.842603:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813307008 00000100:00100000:1.0:1783135518.842606:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813307008 00000100:00100000:1.0:1783135518.842633:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783135518.842641:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813306880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135518.842694:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813306880:12345-0@lo:400:kworker.0 Request processed in 53us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135518.842701:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783135518.842718:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783135518.842724:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813307008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135518.842764:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813307008:12345-0@lo:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135518.842786:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:1.0:1783135518.842807:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135518.842847:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813307392 00000100:00100000:1.0:1783135518.842850:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813307392 00000100:00100000:1.0:1783135518.842893:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783135518.842901:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813307392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135518.842939:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813307392:12345-0@lo:400:kworker.0 Request processed in 38us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135518.842944:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1783135518.842961:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135518.842987:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d13c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813307008:0@lo:400:kworker.0 00000100:00100000:1.0:1783135518.842998:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813306880:0@lo:400:kworker.0 00000100:00100000:1.0:1783135518.843007:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d13ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813307392:0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845218:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d13dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813307136:0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135518.845371:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783135518.845378:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813306752:0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845407:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135518.845430:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d13d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813307264:0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845470:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135518.845499:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813306752 00000100:00100000:0.0:1783135518.845506:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813306752 00000100:00100000:0.0:1783135518.845546:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1783135518.845556:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813306752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845623:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813306752:12345-0@lo:400:kworker.0 Request processed in 69us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135518.845630:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1783135518.845660:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813307136 00000100:00100000:0.0:1783135518.845664:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813307136 00000100:00100000:0.0:1783135518.845691:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783135518.845705:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813307136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845737:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813307136:12345-0@lo:400:kworker.0 Request processed in 39us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135518.845758:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1783135518.845778:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813307264 00000100:00100000:0.0:1783135518.845782:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813307264 00000100:00100000:0.0:1783135518.845840:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783135518.845846:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813307264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845893:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813307264:12345-0@lo:400:kworker.0 Request processed in 48us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135518.845899:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1783135518.845920:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135518.845947:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02d11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813306752:0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845958:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d13d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813307264:0@lo:400:kworker.0 00000100:00100000:0.0:1783135518.845966:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d13dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813307136:0@lo:400:kworker.0 00010000:00010000:3.0:1783135519.677656:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135520.698492:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135521.403035:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135521.403063:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3d13f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813307520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135521.403137:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135521.403203:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813307520 00000100:00100000:3.0:1783135521.403212:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813307520 00000100:00100000:3.0:1783135521.403273:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783135521.403286:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813307520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783135521.403324:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783135521.403362:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135521.403374:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813307520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135521.403384:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783135521.403455:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3d13f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813307520:0@lo:13:osp-pre-1-0.0 00000020:00080000:2.0:1783135521.495554:0:5817:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1783135521.495723:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1783135521.495735:0:5828:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1783135521.730077:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135522.746038:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135522.809866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135522.809914:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135522.810055:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792353536 00000100:00100000:2.0:1783135522.810065:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792353536 00000100:00100000:2.0:1783135522.810126:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 301 00000100:00100000:2.0:1783135522.810135:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792353536:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135522.810206:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792353536:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 71us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135522.810214:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 301 00000100:00100000:0.0:1783135522.810770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135522.810848:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135522.810876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135522.810916:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792354048 00000100:00100000:1.0:1783135522.810921:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792354048 00000100:00100000:1.0:1783135522.810959:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792353664 00000100:00100000:1.0:1783135522.810962:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792353664 00000100:00100000:1.0:1783135522.810985:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 170 00000100:00100000:1.0:1783135522.810992:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792354048:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135522.811036:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2362:x1869752792354048:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 43us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.811042:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 170 00000100:00100000:1.0:1783135522.811072:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 171 00000100:00100000:1.0:1783135522.811078:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:2362:x1869752792353664:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135522.811121:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:2362:x1869752792353664:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 43us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135522.811128:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 171 00000100:00080000:1.0:1783135522.811144:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135522.816105:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792353792 00000100:00100000:3.0:1783135522.816129:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792353792 00000100:00100000:0.0:1783135522.816368:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792353920 00000100:00100000:0.0:1783135522.816373:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792353920 00000100:00100000:3.0:1783135522.816423:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 99 00000100:00100000:3.0:1783135522.816436:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2362:x1869752792353792:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135522.816524:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37c59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2362:x1869752792353792:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 92us (6609us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135522.816546:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 99 00000100:00080000:2.0:1783135522.817584:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135522.817590:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135522.817725:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 100 00000100:00100000:0.0:1783135522.817737:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792353920:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135522.817791:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792353920:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 58us (6913us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135522.817811:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 100 00000100:00100000:1.0:1783135522.864081:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135522.869951:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792354176 00000100:00100000:0.0:1783135522.869969:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792354176 00000100:00100000:0.0:1783135522.870069:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 238 00000100:00100000:0.0:1783135522.870079:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:11272:x1869752792354176:12345-192.168.201.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1783135522.872036:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:11272:x1869752792354176:12345-192.168.201.60@tcp:60:lhsmtool_posix.0 Request processed in 1949us (7957us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135522.872049:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 238 00000100:00100000:1.0:1783135522.875273:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135522.875842:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792354432 00000100:00100000:2.0:1783135522.875853:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792354432 00000100:00100000:2.0:1783135522.875987:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 65 00000100:00100000:2.0:1783135522.875998:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+18:11272:x1869752792354432:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783135522.877642:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+19:11272:x1869752792354432:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 1639us (2747us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1783135522.877655:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 65 00000100:00100000:2.0:1783135523.221723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135523.221923:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792354560 00000100:00100000:1.0:1783135523.221938:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792354560 00000100:00100000:1.0:1783135523.222286:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 239 00000100:00100000:1.0:1783135523.222302:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:12071:x1869752792354560:12345-192.168.201.60@tcp:101:lsof.0 00010000:00010000:1.0:1783135523.222330:0:5795:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135523.222358:0:5795:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d8b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1219d expref: -99 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135523.222440:0:5795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d8bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135523.222457:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d8bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135523.222484:0:5795:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d8bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135523.222766:0:5795:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783135523.222771:0:5795:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1783135523.222934:0:5795:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d8bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5795 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135523.223104:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c400/0xf646e0cda875d8b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1219d expref: 7 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135523.223204:0:5795:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d8bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1219d expref: 6 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135523.223216:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:1.0:1783135523.223219:0:5795:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783135523.223223:0:5795:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121da00, rc 0) 00000100:00100000:1.0:1783135523.223324:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:12071:x1869752792354560:12345-192.168.201.60@tcp:101:lsof.0 Request processed in 1025us (1616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135523.223334:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 239 00000100:00100000:0.0:1783135523.450407:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813307648:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135523.450511:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135523.450723:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813307648 00000100:00100000:2.0:1783135523.450741:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813307648 00000100:00100000:2.0:1783135523.450866:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783135523.450880:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813307648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135523.450944:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135523.451002:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9ded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813307648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135523.451010:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783135523.451583:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813307648:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783135523.452257:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783135523.771373:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135523.964579:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813308032:0@lo:400:kworker.0 00000100:00100000:2.0:1783135523.964669:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813307904:0@lo:400:kworker.0 00000100:00100000:0.0:1783135523.964679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135523.964754:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813308032 00000100:00100000:1.0:1783135523.964765:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813308032 00000100:00100000:1.0:1783135523.964920:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783135523.964933:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813308032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135523.965042:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3b9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813307776:0@lo:400:kworker.0 00000100:00100000:2.0:1783135523.971549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135523.971664:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813308416:0@lo:400:kworker.0 00000100:00100000:2.0:1783135523.971733:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135523.972613:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813308416 00000100:00100000:2.0:1783135523.972998:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813308416 00000100:00100000:2.0:1783135523.973408:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783135523.973421:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813308416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135523.976315:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813308416:12345-0@lo:400:kworker.0 Request processed in 2882us (4565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135523.976334:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783135523.976404:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813307904 00000100:00100000:2.0:1783135523.976414:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813307904 00000100:00100000:2.0:1783135523.976474:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783135523.976691:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813307904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135523.976790:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813307904:12345-0@lo:400:kworker.0 Request processed in 281us (5242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135523.976807:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1783135523.976984:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813307904:0@lo:400:kworker.0 00000100:00100000:2.0:1783135523.977002:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813308416:0@lo:400:kworker.0 00000100:00100000:1.0:1783135523.977194:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813308160:0@lo:400:kworker.0 00000100:00080000:2.0:1783135523.977201:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135523.977208:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135523.977401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135523.978586:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813308032:12345-0@lo:400:kworker.0 Request processed in 13647us (13897us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135523.978611:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1783135523.978885:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813308160 00000100:00100000:2.0:1783135523.978895:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813308160 00000100:00100000:2.0:1783135523.978952:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783135523.978962:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813308160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135523.979339:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813308160:12345-0@lo:400:kworker.0 Request processed in 377us (1937us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135523.979347:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783135523.979476:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135523.979522:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813308288:0@lo:400:kworker.0 00000100:00100000:3.0:1783135523.979562:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135523.979619:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813307776 00000100:00100000:3.0:1783135523.979624:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813307776 00000100:00100000:3.0:1783135523.979662:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1783135523.979670:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813307776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135523.979708:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813307776:12345-0@lo:400:kworker.0 Request processed in 39us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135523.979714:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1783135523.979770:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3b9dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813307776:0@lo:400:kworker.0 00000100:00100000:3.0:1783135523.980567:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813308288 00000100:00100000:3.0:1783135523.980577:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813308288 00000100:00100000:3.0:1783135523.980650:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783135523.980659:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813308288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135523.980717:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813308288:12345-0@lo:400:kworker.0 Request processed in 59us (1153us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135523.980724:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1783135523.980741:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135523.980764:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813308288:0@lo:400:kworker.0 00000100:00100000:1.0:1783135523.982074:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813308160:0@lo:400:kworker.0 00000100:00100000:0.0:1783135523.982681:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813308032:0@lo:400:kworker.0 00010000:00010000:1.0:1783135524.794460:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135525.820081:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135526.527242:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135526.527275:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813308544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135526.527371:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135526.527460:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813308544 00000100:00100000:2.0:1783135526.527469:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813308544 00000100:00100000:2.0:1783135526.527533:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783135526.527543:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813308544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135526.527606:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135526.527658:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c049880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813308544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135526.527665:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783135526.527747:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813308544:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783135526.529110:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1783135526.621999:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00010000:00010000:1.0:1783135526.842842:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135527.738132:0:11538:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783135527.738157:0:11538:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783135527.743751:0:11538:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1783135527.743774:0:11538:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:3.0:1783135527.798524:0:12570:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:25:25 (1783135525) 00010000:00010000:2.0:1783135527.866483:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135527.929147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135527.929201:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135527.929242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135527.929265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135527.929302:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135527.929340:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792355072 00000100:00100000:3.0:1783135527.929352:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792355072 00000100:00100000:3.0:1783135527.929427:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792354944 00000100:00100000:3.0:1783135527.929431:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792354944 00000100:00100000:3.0:1783135527.929460:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 103 00000100:00100000:3.0:1783135527.929473:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792355072:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135527.929576:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2362:x1869752792355072:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 106us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.929585:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 103 00000100:00100000:3.0:1783135527.929613:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 104 00000100:00100000:3.0:1783135527.929621:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2362:x1869752792354944:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135527.929640:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792354816 00000100:00100000:0.0:1783135527.929647:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792354816 00000100:00100000:3.0:1783135527.929652:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+7:2362:x1869752792354944:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.929660:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 104 00000100:00100000:3.0:1783135527.929689:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792354688 00000100:00100000:3.0:1783135527.929693:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792354688 00000100:00100000:0.0:1783135527.929695:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792355200 00000100:00100000:0.0:1783135527.929702:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792355200 00000100:00100000:3.0:1783135527.929739:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 303 00000100:00100000:3.0:1783135527.929747:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792354688:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135527.929756:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 175 00000100:00100000:0.0:1783135527.929768:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3d13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:2362:x1869752792354816:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135527.929777:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792354688:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 30us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135527.929805:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 303 00000100:00100000:0.0:1783135527.929837:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3d13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:2362:x1869752792354816:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 51us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135527.929857:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 175 00000100:00100000:3.0:1783135527.929881:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 176 00000100:00100000:3.0:1783135527.929890:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3b9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2362:x1869752792355200:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135527.929931:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3b9dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2362:x1869752792355200:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 42us (628us total) trans 0 rc 0/0 00000100:00080000:2.0:1783135527.936499:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135527.936517:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135527.936521:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135527.943290:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 176 00000100:00100000:0.0:1783135528.571604:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135528.571638:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813308672:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135528.571756:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135528.571890:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813308672 00000100:00100000:0.0:1783135528.571901:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813308672 00000100:00100000:0.0:1783135528.571980:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1783135528.571994:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813308672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135528.572041:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135528.572092:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813308672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135528.572100:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1783135528.572127:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135528.572177:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3be36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813308672:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783135528.892112:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135529.084081:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813309184:0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.084181:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135529.084252:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1783135529.084259:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813308800:0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.084291:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135529.085042:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813309312:0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.085101:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135529.087932:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813308928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.088028:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135529.088078:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135529.088088:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813309056:0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.088114:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135529.088162:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813309184 00000100:00100000:1.0:1783135529.088172:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813309184 00000100:00100000:1.0:1783135529.088240:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813308928 00000100:00100000:1.0:1783135529.088244:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813308928 00000100:00100000:1.0:1783135529.088258:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813309056 00000100:00100000:1.0:1783135529.088260:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813309056 00000100:00100000:1.0:1783135529.088276:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783135529.088284:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813309184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.088373:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813309184:12345-0@lo:400:kworker.0 Request processed in 88us (4192us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135529.088380:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783135529.088401:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783135529.088407:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813308928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.088438:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813308928:12345-0@lo:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135529.088460:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1783135529.088473:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783135529.088478:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813309056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.088506:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813309056:12345-0@lo:400:kworker.0 Request processed in 28us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135529.088512:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1783135529.088533:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813308800 00000100:00100000:1.0:1783135529.088537:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813308800 00000100:00100000:1.0:1783135529.088565:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1783135529.088572:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813308800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.090016:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813308800:12345-0@lo:400:kworker.0 Request processed in 1441us (5719us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135529.090026:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:1.0:1783135529.090089:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135529.090143:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db5b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813309056:0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.090158:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813308928:0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.090198:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813308800:0@lo:400:kworker.0 00000100:00100000:1.0:1783135529.090211:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813309184:0@lo:400:kworker.0 00000100:00100000:2.0:1783135529.098651:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813309312 00000100:00100000:2.0:1783135529.098671:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813309312 00000100:00100000:2.0:1783135529.098858:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783135529.098872:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813309312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135529.099007:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813309312:12345-0@lo:400:kworker.0 Request processed in 140us (13905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135529.099015:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1783135529.106230:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135529.106338:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813309312:0@lo:400:kworker.0 00010000:00010000:0.0:1783135529.917431:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135530.942681:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135531.642142:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813309440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135531.642216:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135531.642666:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813309440 00000100:00100000:0.0:1783135531.642677:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813309440 00000100:00100000:0.0:1783135531.642754:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783135531.642764:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813309440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135531.642799:0:6591:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135531.644999:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813309440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2227us (2772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135531.645012:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783135531.645094:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813309440:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783135531.645305:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783135531.962186:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135532.986159:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135533.059149:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135533.059203:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135533.059280:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135533.059403:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792355584 00000100:00100000:1.0:1783135533.059419:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792355584 00000100:00100000:1.0:1783135533.059487:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 106 00000100:00100000:1.0:1783135533.059498:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3be36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792355584:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135533.059564:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3be36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+7:2361:x1869752792355584:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 69us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135533.059571:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 106 00000100:00100000:3.0:1783135533.059664:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792355456 00000100:00100000:3.0:1783135533.059669:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792355456 00000100:00100000:3.0:1783135533.059713:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 180 00000100:00100000:3.0:1783135533.059722:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:2361:x1869752792355456:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135533.059754:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+18:2361:x1869752792355456:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 34us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135533.059762:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 180 00000100:00080000:0.0:1783135533.060225:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135533.060231:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135533.060289:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792355328 00000100:00100000:2.0:1783135533.060294:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792355328 00000100:00100000:2.0:1783135533.060370:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 305 00000100:00100000:2.0:1783135533.060379:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792355328:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135533.060422:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2361:x1869752792355328:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 45us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135533.060429:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 305 00000100:00100000:1.0:1783135533.075144:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135533.075268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135533.076070:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792355840 00000100:00100000:3.0:1783135533.076085:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792355840 00000100:00100000:3.0:1783135533.076186:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 181 00000100:00100000:3.0:1783135533.076197:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2360:x1869752792355840:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135533.076286:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2360:x1869752792355840:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 91us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135533.076294:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 181 00000100:00080000:0.0:1783135533.076644:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135533.078121:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792355712 00000100:00100000:2.0:1783135533.078132:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792355712 00000100:00100000:3.0:1783135533.078327:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 72 00000100:00100000:3.0:1783135533.078339:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+5:2359:x1869752792355712:12345-192.168.201.60@tcp:9:kworker.0 00000020:00000080:3.0:1783135533.078366:0:6589:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875cc0d 00000100:00080000:3.0:1783135533.078390:0:6589:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d619800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135533.078434:0:6589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1783135533.078718:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0c7819a6-778a-4617-af33-00460db74182+2:2359:x1869752792355712:12345-192.168.201.60@tcp:9:kworker.0 Request processed in 380us (3582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135533.078726:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 72 00010000:00010000:2.0:1783135533.080720:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135533.080885:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135533.326506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135533.326655:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792356096 00000100:00100000:2.0:1783135533.326671:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792356096 00000100:00100000:2.0:1783135533.326763:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 66 00000100:00100000:2.0:1783135533.326777:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+18:12292:x1869752792356096:12345-192.168.201.60@tcp:35:umount.0 00000100:00100000:2.0:1783135533.327801:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+19:12292:x1869752792356096:12345-192.168.201.60@tcp:35:umount.0 Request processed in 1009us (1294us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1783135533.327846:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 66 00000100:00100000:1.0:1783135533.329956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135533.330077:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792356352 00000100:00100000:0.0:1783135533.330091:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792356352 00000100:00100000:0.0:1783135533.330153:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 67 00000100:00100000:0.0:1783135533.330162:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+19:12292:x1869752792356352:12345-192.168.201.60@tcp:35:umount.0 00000100:00100000:0.0:1783135533.330507:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+20:12292:x1869752792356352:12345-192.168.201.60@tcp:35:umount.0 Request processed in 344us (565us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1783135533.330512:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 67 00000100:00100000:3.0:1783135533.332148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135533.332298:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792356608 00000100:00100000:2.0:1783135533.332312:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792356608 00000100:00100000:2.0:1783135533.332378:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 68 00000100:00100000:2.0:1783135533.332390:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f26324850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+20:12292:x1869752792356608:12345-192.168.201.60@tcp:35:umount.0 00000100:00100000:2.0:1783135533.333117:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f26324850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0c7819a6-778a-4617-af33-00460db74182+21:12292:x1869752792356608:12345-192.168.201.60@tcp:35:umount.0 Request processed in 727us (980us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783135533.333126:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 68 00000100:00100000:1.0:1783135533.335230:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135533.335400:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792356864 00000100:00100000:0.0:1783135533.335412:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792356864 00000100:00100000:0.0:1783135533.335485:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:0.0:1783135533.335496:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+21:12292:x1869752792356864:12345-192.168.201.60@tcp:35:umount.0 00000100:00100000:0.0:1783135533.336109:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03333100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0c7819a6-778a-4617-af33-00460db74182+22:12292:x1869752792356864:12345-192.168.201.60@tcp:35:umount.0 Request processed in 613us (891us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1783135533.336119:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 69 00000100:00100000:1.0:1783135533.338671:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135533.338710:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135533.338798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135533.339771:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792356992 00000100:00100000:2.0:1783135533.339787:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792356992 00000100:00100000:2.0:1783135533.339888:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792357120 00000100:00100000:2.0:1783135533.339892:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792357120 00000100:00100000:2.0:1783135533.339917:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792357248 00000100:00100000:2.0:1783135533.339919:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792357248 00000100:00100000:2.0:1783135533.339943:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:2.0:1783135533.339954:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+15:2362:x1869752792356992:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135533.339975:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135533.339999:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05220800/0xf646e0cda875c935 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d28 expref: 15 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135533.340022:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135533.340090:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02ce3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+14:2362:x1869752792356992:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 137us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135533.340099:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:2.0:1783135533.340168:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:2.0:1783135533.340174:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+13:2362:x1869752792357120:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135533.340201:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135533.340211:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05221800/0xf646e0cda875c89b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11cf0 expref: 13 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135533.340219:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135533.340235:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+12:2362:x1869752792357120:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 62us (1525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135533.340241:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:2.0:1783135533.340252:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:2.0:1783135533.340256:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+11:2362:x1869752792357248:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783135533.340262:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135533.340270:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487000/0xf646e0cda875cb49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11df3 expref: 11 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135533.340278:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135533.340291:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2362:x1869752792357248:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 35us (1501us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135533.340296:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:3.0:1783135533.342551:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135533.342909:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792357632 00000100:00100000:1.0:1783135533.342920:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792357632 00000100:00100000:1.0:1783135533.343134:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 73 00000100:00100000:1.0:1783135533.343147:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+7:2359:x1869752792357632:12345-192.168.201.60@tcp:9:umount.0 00000020:00000080:1.0:1783135533.343202:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875ce75 00000020:00010000:1.0:1783135533.343215:0:6590:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8f3c270000: total 0 00000100:00080000:1.0:1783135533.343222:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c277000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135533.343281:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1783135533.343584:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0c7819a6-778a-4617-af33-00460db74182+5:2359:x1869752792357632:12345-192.168.201.60@tcp:9:umount.0 Request processed in 437us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135533.343593:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 73 00000020:00010000:0.0:1783135533.343657:0:6603:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8f3c270000: total 0 00010000:00010000:0.0:1783135533.343696:0:6603:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8f3c270000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1783135533.343768:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875d211 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fc8 expref: 4 pid: 6589 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.344607:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d7adf8a/0xf646e0cda875d8af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12196 expref: 3 pid: 8303 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.344633:0:6603:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8f3c270000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1783135533.344654:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135533.344657:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135533.344659:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135533.348337:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135533.348427:0:9499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792358656 00000100:00100000:3.0:1783135533.348439:0:9499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792358656 00000100:00100000:3.0:1783135533.348519:0:9499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 240 00000100:00100000:3.0:1783135533.348528:0:9499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+22:2359:x1869752792358656:12345-192.168.201.60@tcp:39:umount.0 00000020:00000080:3.0:1783135533.348567:0:9499:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c8a9 00000020:00010000:3.0:1783135533.348582:0:9499:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8f3c436800: total 0 00000100:00080000:3.0:1783135533.348586:0:9499:0:(import.c:65:import_set_state_nolock()) ffff8e8e03cf4000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135533.348614:0:9499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1783135533.349081:0:9499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0c7819a6-778a-4617-af33-00460db74182+21:2359:x1869752792358656:12345-192.168.201.60@tcp:39:umount.0 Request processed in 551us (757us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1783135533.349090:0:9499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 240 00000020:00010000:0.0:1783135533.349152:0:5784:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8f3c436800: total 0 00010000:00010000:0.0:1783135533.349206:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8f3c436800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1783135533.349245:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135533.349249:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135533.349258:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875d790 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12149 expref: 20 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349282:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:0.0:1783135533.349284:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135533.349288:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043a00/0xf646e0cda875ced0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11eef expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349302:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135533.349305:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783135533.349309:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d800/0xf646e0cda875d28f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11feb expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349325:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:0.0:1783135533.349328:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783135533.349349:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875d0f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11f7b expref: 17 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349366:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8e8f180c6600) 00010000:00010000:0.0:1783135533.349368:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783135533.349372:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05220200/0xf646e0cda875cbe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e1d expref: 16 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349394:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135533.349396:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135533.349400:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39a00/0xf646e0cda875d870 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12181 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349415:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:0.0:1783135533.349417:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135533.349420:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875d273 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fe4 expref: 14 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349428:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f032fcb00) 00010000:00010000:0.0:1783135533.349430:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135533.349432:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221200/0xf646e0cda875cb8f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e08 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349441:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:0.0:1783135533.349442:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135533.349445:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2a00/0xf646e0cda875d1d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fb3 expref: 12 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349452:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8f032fc400) 00010000:00010000:0.0:1783135533.349458:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135533.349461:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f05221c00/0xf646e0cda875cb73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11e01 expref: 11 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349472:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8e8f10923600) 00010000:00010000:0.0:1783135533.349473:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783135533.349475:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875d1fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11fc1 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349485:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8e8f10923300) 00010000:00010000:0.0:1783135533.349486:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135533.349488:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c487800/0xf646e0cda875d56e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab120bd expref: 9 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349498:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8e8f1a154200) 00010000:00010000:0.0:1783135533.349500:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783135533.349501:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486a00/0xf646e0cda875d89a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1218f expref: 8 pid: 9499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135533.349512:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8f3c436800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1783135533.349521:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135533.349523:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135533.349524:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135533.690134:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135533.694898:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813309568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135533.695016:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135533.700924:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813309568 00000100:00100000:0.0:1783135533.700947:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813309568 00000100:00100000:0.0:1783135533.701160:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783135533.701176:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813309568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135533.701231:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135533.701375:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813309568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (6358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135533.701634:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813309568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135533.701921:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1783135533.703859:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783135534.010151:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135534.053415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135534.054129:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792358784 00000100:00100000:1.0:1783135534.054145:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792358784 00000100:00100000:1.0:1783135534.054247:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:1.0:1783135534.054260:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+10:2361:x1869752792358784:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135534.054282:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135534.054311:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05220c00/0xf646e0cda875c97b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d3d expref: 10 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135534.054335:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135534.055196:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135534.055405:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:2361:x1869752792358784:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 1145us (2007us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135534.055418:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:1.0:1783135534.055524:0:5780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792358912 00000100:00100000:1.0:1783135534.055531:0:5780:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792358912 00000100:00100000:1.0:1783135534.055576:0:5780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:1.0:1783135534.055585:0:5780:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+9:2360:x1869752792358912:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135534.055597:0:5780:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135534.055626:0:5780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05220e00/0xf646e0cda875c982 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d67 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135534.055645:0:5780:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135534.055665:0:5780:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:2360:x1869752792358912:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 82us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135534.056873:0:5780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:2.0:1783135534.059498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135534.059784:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792359040 00000100:00100000:1.0:1783135534.059796:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792359040 00000100:00100000:1.0:1783135534.059902:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:1.0:1783135534.059924:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ebba92a-2ae4-47ab-a127-5cfd3761e278+8:2361:x1869752792359040:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783135534.059946:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135534.059973:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f05221a00/0xf646e0cda875cb42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11dec expref: 8 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135534.059997:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135534.060079:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4ebba92a-2ae4-47ab-a127-5cfd3761e278+7:2361:x1869752792359040:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 158us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135534.060089:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:2.0:1783135534.062758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135534.063062:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792359296 00000100:00100000:3.0:1783135534.063077:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792359296 00000100:00100000:3.0:1783135534.063162:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 241 00000100:00100000:3.0:1783135534.063175:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+6:2359:x1869752792359296:12345-192.168.201.60@tcp:39:umount.0 00000020:00000080:3.0:1783135534.063235:0:5795:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c990 00000020:00010000:3.0:1783135534.063246:0:5795:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8f3bf6b800: total 0 00000100:00080000:3.0:1783135534.063253:0:5795:0:(import.c:65:import_set_state_nolock()) ffff8e8f3bf6f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135534.063284:0:5795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1783135534.064242:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:39ee5324-0b44-4a89-a00a-214bdc9ac96f+5:2359:x1869752792359296:12345-192.168.201.60@tcp:39:umount.0 Request processed in 1059us (1489us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1783135534.064257:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 241 00000020:00010000:0.0:1783135534.064493:0:6603:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8f3bf6b800: total 0 00010000:00010000:0.0:1783135534.064499:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135534.064564:0:6603:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8f3bf6b800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783135534.064620:0:6603:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f18315400) 00010000:00010000:0.0:1783135534.064624:0:6603:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135534.064634:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121da00/0xf646e0cda875d8bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1219d expref: 4 pid: 5795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135534.064662:0:6603:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8f3bf6b800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1783135534.064673:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135534.064675:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135534.064676:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135534.094043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135534.094221:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792359552 00000100:00100000:1.0:1783135534.094237:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792359552 00000100:00100000:1.0:1783135534.094330:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 306 00000100:00100000:1.0:1783135534.094348:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+7:2359:x1869752792359552:12345-192.168.201.60@tcp:251:umount.0 00000020:00000080:1.0:1783135534.094420:0:5789:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c886 00000020:00010000:1.0:1783135534.094443:0:5789:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8f3c6f7000: total 0 00000100:00080000:1.0:1783135534.094449:0:5789:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c6f5800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783135534.094530:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4ebba92a-2ae4-47ab-a127-5cfd3761e278+3:2359:x1869752792359552:12345-192.168.201.60@tcp:251:umount.0 Request processed in 191us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135534.094537:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 306 00000020:00010000:0.0:1783135534.094750:0:5784:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8f3c6f7000: total 0 00010000:00010000:0.0:1783135534.094797:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8f3c6f7000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783135534.094863:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156c00/0xf646e0cda875c93c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab11d2f expref: 2 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135534.094880:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8f3c6f7000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783135534.094887:0:5784:0:(genops.c:906:class_export_put()) final put ffff8e8f3c6f7000/4ebba92a-2ae4-47ab-a127-5cfd3761e278 00010000:00010000:0.0:1783135534.094898:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135534.094900:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135534.094901:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783135534.094941:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c6f7000/4ebba92a-2ae4-47ab-a127-5cfd3761e278 for MGS 00000020:00000080:2.0:1783135534.094977:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3c6f5800 for MGS 00000100:00100000:0.0:1783135534.202337:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813309952:0@lo:400:kworker.0 00000100:00100000:0.0:1783135534.202431:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135534.202515:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783135534.202520:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813310080:0@lo:400:kworker.0 00000100:00100000:0.0:1783135534.202552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135534.202623:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813309952 00000100:00100000:0.0:1783135534.202632:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813309952 00000100:00100000:1.0:1783135534.202677:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813309696:0@lo:400:kworker.0 00000100:00100000:0.0:1783135534.202704:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813310080 00000100:00100000:0.0:1783135534.202708:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813310080 00000100:00100000:0.0:1783135534.202728:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1783135534.202735:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813309952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135534.202802:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813309952:12345-0@lo:400:kworker.0 Request processed in 65us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135534.202811:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783135534.202852:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135534.202885:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813310208:0@lo:400:kworker.0 00000100:00100000:0.0:1783135534.202903:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1783135534.202911:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813310080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135534.202943:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135534.202946:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813310080:12345-0@lo:400:kworker.0 Request processed in 35us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135534.202952:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1783135534.202974:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135534.202984:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813309824:0@lo:400:kworker.0 00000100:00100000:0.0:1783135534.203003:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813310080:0@lo:400:kworker.0 00000100:00100000:1.0:1783135534.203012:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135534.203019:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813309952:0@lo:400:kworker.0 00000100:00100000:1.0:1783135534.203047:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813309696 00000100:00100000:1.0:1783135534.203052:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813309696 00000100:00100000:0.0:1783135534.203052:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813309824 00000100:00100000:0.0:1783135534.203058:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813309824 00000100:00100000:0.0:1783135534.203084:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783135534.203090:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1783135534.203095:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813309824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135534.203104:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813309696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135534.203143:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813309824:12345-0@lo:400:kworker.0 Request processed in 49us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135534.203153:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783135534.203154:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3311:x1869752813309696:12345-0@lo:400:kworker.0 Request processed in 52us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135534.203165:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1783135534.203188:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813309824:0@lo:400:kworker.0 00000100:00100000:1.0:1783135534.203202:0:8303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813310208 00000100:00100000:1.0:1783135534.203206:0:8303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813310208 00000100:00100000:0.0:1783135534.203217:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813309696:0@lo:400:kworker.0 00000100:00100000:1.0:1783135534.203231:0:8303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783135534.203238:0:8303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813310208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135534.203263:0:8303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813310208:12345-0@lo:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135534.203267:0:8303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135534.203298:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813310208:0@lo:400:kworker.0 00000100:00080000:3.0:1783135534.206029:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783135534.206039:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1783135534.765433:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:0.0:1783135534.765448:0:7494:0:(genops.c:906:class_export_put()) final put ffff8e8f3d61e000/0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:2.0:1783135534.765565:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3d61e000/0c7819a6-778a-4617-af33-00460db74182 for lustre-OST0001 00000020:00000080:2.0:1783135534.765632:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3d619800 for lustre-OST0001 00010000:00010000:3.0:1783135535.035057:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135536.058052:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783135536.242342:0:12768:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783135536.273047:0:12768:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1783135536.273097:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.273114:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.273122:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.273129:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.273147:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783135536.273153:0:12768:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783135536.273176:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135536.273180:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783135536.273186:0:12768:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783135536.273210:0:12768:0:(import.c:65:import_set_state_nolock()) ffff8e8f2fd44800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783135536.273454:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135536.273475:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.273483:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3a00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135536.273486:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.273495:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135536.273503:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135536.273509:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135536.273512:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783135536.273514:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783135536.273543:0:5784:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.273550:0:5784:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135536.273588:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.273595:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3a00/0xf646e0cda875c90b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c912 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.273607:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135536.273609:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135536.273611:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135536.273627:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813310336:0@lo:39:umount.0 00000100:00100000:2.0:1783135536.273688:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135536.273758:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813310336 00000100:00100000:2.0:1783135536.273765:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813310336 00000100:00100000:2.0:1783135536.273808:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1783135536.273841:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869752813310336:12345-0@lo:39:umount.0 00000020:00000080:2.0:1783135536.273867:0:5794:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c695 00000100:00080000:2.0:1783135536.273876:0:5794:0:(import.c:65:import_set_state_nolock()) ffff8e8f2fcda000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783135536.273932:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3310:x1869752813310336:12345-0@lo:39:umount.0 Request processed in 115us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135536.273939:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1783135536.273949:0:5794:0:(genops.c:906:class_export_put()) final put ffff8e8f2fcde000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1783135536.273973:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783135536.273982:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f2fcde000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783135536.274025:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f2fcda000 for lustre-MDT0000 00000100:00100000:3.0:1783135536.274132:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813310464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783135536.274179:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783135536.274247:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f2fd44800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1783135536.274256:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813310336:0@lo:39:umount.0 00000100:00100000:3.0:1783135536.274284:0:5782:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813310464 00000100:00100000:3.0:1783135536.274288:0:5782:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813310464 00000100:00100000:3.0:1783135536.274320:0:5782:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135536.274327:0:5782:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3312:x1869752813310464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135536.274337:0:5782:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135536.274351:0:5782:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487e00/0xf646e0cda875c912 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c90b expref: 19 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135536.274364:0:5782:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135536.274391:0:5782:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:3312:x1869752813310464:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135536.274398:0:5782:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783135536.274424:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813310464:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783135536.274767:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135536.274770:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783135536.274774:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1783135536.275725:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275751:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275759:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275765:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275790:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783135536.275796:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275802:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275807:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275813:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275844:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135536.275850:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275856:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275871:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275877:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275888:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783135536.275894:0:12768:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275900:0:12768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275906:0:12768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275912:0:12768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135536.275918:0:12768:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1783135536.275921:0:12768:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1783135536.275946:0:12768:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1783135536.275950:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1783135536.275954:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135536.275959:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1783135536.275965:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8e8f3d108000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135536.275971:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff8e8e0181a000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135536.275979:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8e8f3bf6b800 39ee5324-0b44-4a89-a00a-214bdc9ac96f 192.168.201.60@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135536.275990:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff8e8f3c436800 0c7819a6-778a-4617-af33-00460db74182 192.168.201.60@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:0.0:1783135536.275995:0:12768:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff8e8f09d099c0) has exports, disconnecting them 00000020:00080000:0.0:1783135536.275999:0:12768:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e8f3d108000), last request at 1783135534 00000020:00000080:0.0:1783135536.276006:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c808 00000100:00080000:0.0:1783135536.276024:0:12768:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d109800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1783135536.276071:0:12768:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8f3d108000): rc 0 00000020:00000080:0.0:1783135536.276074:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3d108000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1783135536.276368:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1783135536.276375:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276382:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05220a00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135536.276386:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276395:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135536.276402:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135536.276406:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135536.276409:0:6603:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1783135536.276411:0:6603:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1783135536.276451:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276457:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135536.276490:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276497:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05220a00/0xf646e0cda875c919 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c920 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276507:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783135536.276510:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276514:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05220600 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135536.276517:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276523:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135536.276529:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135536.276535:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135536.276536:0:6603:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783135536.276538:0:6603:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783135536.276548:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276553:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135536.276558:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276580:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05220600/0xf646e0cda875c840 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c847 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276592:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135536.276595:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276601:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486e00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135536.276604:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276610:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135536.276617:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135536.276622:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783135536.276624:0:6603:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783135536.276626:0:6603:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783135536.276639:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276645:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135536.276661:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276668:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486e00/0xf646e0cda875cb34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875cb3b expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276688:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135536.276691:0:6603:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276696:0:6603:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42156e00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135536.276699:0:6603:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276705:0:6603:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135536.276710:0:6603:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135536.276715:0:6603:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783135536.276717:0:6603:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783135536.276719:0:6603:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783135536.276730:0:6603:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276736:0:6603:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135536.276742:0:6603:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276748:0:6603:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42156e00/0xf646e0cda875c5f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c5fb expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.276759:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135536.276761:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135536.276767:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135536.276785:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813310720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135536.276873:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135536.276918:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135536.276924:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813310592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135536.276947:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135536.276976:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813310848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135536.276996:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135536.277012:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135536.277017:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813310976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135536.277123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135536.277153:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813310720 00000100:00100000:2.0:1783135536.277159:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813310720 00000100:00100000:2.0:1783135536.277204:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813310592 00000100:00100000:2.0:1783135536.277207:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813310592 00000100:00100000:2.0:1783135536.277219:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813310848 00000100:00100000:2.0:1783135536.277221:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813310848 00000100:00100000:2.0:1783135536.277232:0:11521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813310976 00000100:00100000:2.0:1783135536.277234:0:11521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813310976 00000100:00100000:2.0:1783135536.277261:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135536.277268:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+21:3314:x1869752813310720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135536.277280:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135536.277293:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b2e00/0xf646e0cda875c847 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c840 expref: 21 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.277308:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135536.277342:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02ce3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+20:3314:x1869752813310720:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135536.277349:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135536.277402:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135536.277408:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c049c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+19:3314:x1869752813310592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135536.277414:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135536.277423:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b3000/0xf646e0cda875c920 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c919 expref: 19 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.277431:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135536.277452:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c049c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+18:3314:x1869752813310592:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135536.277458:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135536.277470:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135536.277476:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+17:3311:x1869752813310848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135536.277483:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135536.277491:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487600/0xf646e0cda875cb3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875cb34 expref: 17 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.277499:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135536.277522:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+16:3311:x1869752813310848:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135536.277528:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783135536.277539:0:11521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135536.277546:0:11521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+15:3311:x1869752813310976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135536.277553:0:11521:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135536.277560:0:11521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b2800/0xf646e0cda875c5fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c5f4 expref: 15 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135536.277584:0:11521:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135536.277611:0:11521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c049180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a+14:3311:x1869752813310976:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135536.277617:0:11521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1783135536.277642:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135536.277666:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813310976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135536.277675:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3311:1869752813310848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135536.277699:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135536.277712:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813310592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135536.277719:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813310720:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783135536.285371:0:12768:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8e8e0181a000), last request at 1783135534 00000020:00000080:0.0:1783135536.285386:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c73d 00000100:00080000:0.0:1783135536.285401:0:12768:0:(import.c:65:import_set_state_nolock()) ffff8e8e01818000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783135536.285477:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783135536.285508:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3d108000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1783135536.285575:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3d109800 for lustre-MDT0000 00000020:00080000:3.0:1783135536.285596:0:12768:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8e0181a000): rc 0 00000020:00000080:3.0:1783135536.285617:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8e0181a000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1783135536.285641:0:12768:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9c27415f7ae0 00000100:00080000:3.0:1783135536.285667:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783135536.285671:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1783135536.285692:0:12768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1783135536.285754:0:12768:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1783135536.285780:0:12768:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d108800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1783135536.285798:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783135536.285801:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1783135536.285808:0:12768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135536.285913:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813311104:0@lo:9:umount.0 00000100:00100000:3.0:1783135536.285996:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1783135536.286154:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8e0181a000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1783135536.286193:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8e01818000 for lustre-MDT0000 00000100:00100000:3.0:1783135536.286237:0:6587:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813311104 00000100:00100000:3.0:1783135536.286245:0:6587:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813311104 00000100:00100000:3.0:1783135536.286303:0:6587:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783135536.286312:0:6587:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869752813311104:12345-0@lo:9:umount.0 00000020:00000080:3.0:1783135536.286340:0:6587:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c78a 00000100:00080000:3.0:1783135536.286347:0:6587:0:(import.c:65:import_set_state_nolock()) ffff8e8e0182e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1783135536.286376:0:6587:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:3.0:1783135536.286557:0:6587:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3310:x1869752813311104:12345-0@lo:9:umount.0 Request processed in 245us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135536.286565:0:6587:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1783135536.286621:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d108800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1783135536.286626:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1783135536.286627:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135536.286631:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813311104:0@lo:9:umount.0 00000100:00080000:3.0:1783135536.286652:0:12768:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1783135536.286664:0:12768:0:(import.c:65:import_set_state_nolock()) ffff8e8e03cf1800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1783135536.286694:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813311232:0@lo:9:umount.0 00000100:00100000:3.0:1783135536.286720:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1783135536.286767:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8e8f09d099c0) has no exports 00000100:00080000:2.0:1783135536.287025:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783135536.287048:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135536.287183:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813311232 00000100:00100000:1.0:1783135536.287188:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813311232 00000100:00100000:1.0:1783135536.287240:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783135536.287249:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1869752813311232:12345-0@lo:9:umount.0 00000020:00000080:1.0:1783135536.287268:0:6590:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c871 00000100:00080000:1.0:1783135536.287275:0:6590:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c433800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783135536.287301:0:6590:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1783135536.287618:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3310:x1869752813311232:12345-0@lo:9:umount.0 Request processed in 369us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135536.287636:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1783135536.287713:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8e03cf1800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1783135536.287721:0:3310:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1783135536.287723:0:3310:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1783135536.287726:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813311232:0@lo:9:umount.0 00000100:00080000:2.0:1783135536.287887:0:5790:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783135536.287894:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1783135536.309738:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff8e8f09d099c0) has no exports 00000020:00000080:2.0:1783135536.389352:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c64f 00000020:00000080:2.0:1783135536.389369:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3d1e7800/lustre-QMT0000_UUID 00000020:01000000:2.0:1783135536.389392:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1783135536.389431:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3d1e7800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1783135536.389489:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135536.389499:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1783135536.389504:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff8e8f3fc33380) has no exports 00000020:00000080:3.0:1783135536.390213:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c648 00000020:00000080:3.0:1783135536.390220:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3fc43800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783135536.390355:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3fc43800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135536.394800:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135536.394967:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783135536.394974:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3db86000/lustre-QMT0000_UUID 00000020:00000080:3.0:1783135536.394979:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3db86000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1783135536.394989:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00080000:0.0:1783135536.809296:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1783135536.809325:0:5817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 39ee5324-0b44-4a89-a00a-214bdc9ac96f 00000001:00080000:0.0:1783135536.809334:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1783135536.809337:0:5817:0:(genops.c:906:class_export_put()) final put ffff8e8f3bf6b800/39ee5324-0b44-4a89-a00a-214bdc9ac96f 00000001:00100000:0.0:1783135536.809351:0:5817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000001:00080000:0.0:1783135536.809355:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1783135536.809357:0:5817:0:(genops.c:906:class_export_put()) final put ffff8e8f3c436800/0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:0.0:1783135536.811955:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3bf6b800/39ee5324-0b44-4a89-a00a-214bdc9ac96f for lustre-MDT0000 00000020:00000080:0.0:1783135536.812043:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c436800/0c7819a6-778a-4617-af33-00460db74182 for lustre-MDT0000 00000020:00000080:0.0:1783135536.812080:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3bf6f800 for lustre-MDT0000 00000020:00000080:0.0:1783135536.812085:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8e03cf4000 for lustre-MDT0000 00000001:00100000:1.0:1783135536.860580:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0c7819a6-778a-4617-af33-00460db74182 00000020:00000080:1.0:1783135536.860589:0:6616:0:(genops.c:906:class_export_put()) final put ffff8e8f3c270000/0c7819a6-778a-4617-af33-00460db74182 00000001:00100000:1.0:1783135536.860619:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135536.860621:0:6616:0:(genops.c:906:class_export_put()) final put ffff8e8e0182e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135536.860786:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c270000/0c7819a6-778a-4617-af33-00460db74182 for lustre-OST0000 00000020:00000080:2.0:1783135536.860874:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8e0182e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1783135536.860897:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3c277000 for lustre-OST0000 00000020:00000080:2.0:1783135536.860904:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8e0182e000 for lustre-OST0000 00010000:00010000:0.0:1783135537.082437:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135538.106153:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1783135538.425994:0:12768:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8f3d936e40 - data ffff8e8f2d3b7bd0/ffff8e8f3d964800 00000020:01000000:3.0:1783135538.426219:0:12768:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8f3fd54ae0 - data ffff8e8f1dc28bd0/ffff8e8f3cf22800 00000001:00000004:3.0:1783135538.440274:0:12768:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1783135538.601515:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783135538.601542:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1783135538.601576:0:12768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135538.601579:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783135538.602729:0:6699:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783135538.602738:0:6699:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1783135538.602752:0:6699:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1783135538.604236:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783135538.604245:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1783135538.604312:0:12768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135538.604316:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783135538.604702:0:7804:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783135538.604709:0:7804:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1783135538.604734:0:7804:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1783135538.753317:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c617 00000020:00000080:3.0:1783135538.753334:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f10b6c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783135538.757718:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f10b6c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1783135538.759039:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c62c 00000020:00000080:3.0:1783135538.759055:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3db82800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783135538.759074:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1783135538.759082:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135538.759101:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135538.759105:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff8e8f09d0b380) has no exports 00000004:01000000:3.0:1783135538.759282:0:12768:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1783135538.759292:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c86a 00000020:00000080:3.0:1783135538.759297:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3c437800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783135538.759302:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783135538.759306:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135538.759313:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135538.759316:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff8e8f37c4b380) has no exports 00000020:00000080:3.0:1783135538.759324:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c863 00000020:00000080:3.0:1783135538.759327:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8e03cf7800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783135538.759721:0:12768:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783135538.759729:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1783135538.759735:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1783135538.759744:0:12768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135538.759747:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135538.759785:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135538.759794:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135538.759801:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c783 00000020:00000080:3.0:1783135538.759807:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3d10e000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1783135538.759811:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1783135538.759844:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135538.759849:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1783135538.759851:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff8e8f10b63380) has no exports 00000020:00000080:3.0:1783135538.759856:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c77c 00000020:00000080:3.0:1783135538.759859:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f2fcd9800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1783135538.760210:0:12768:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1783135538.760214:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1783135538.760216:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1783135538.760220:0:12768:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1783135538.760221:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783135538.760253:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135538.760267:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135538.760299:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135538.760303:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783135538.760329:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c633 00000020:00000080:3.0:1783135538.760334:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3db81000/lustre-MDD0000_UUID 00000020:01000000:3.0:1783135538.760338:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1783135538.760341:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135538.760344:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135538.760347:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff8e8f09d0cd40) has no exports 00000020:00000080:3.0:1783135538.760377:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135538.760379:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1783135538.760382:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c63a 00000020:00000080:3.0:1783135538.760385:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f3db85800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783135538.760392:0:12768:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8f063e9800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1783135538.760396:0:12768:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8f063e9800 3 00000020:01000004:3.0:1783135538.760399:0:12768:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8f063e9800 from lustre-MDT0000 00000020:00000080:3.0:1783135538.760419:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135538.760422:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1783135538.760425:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f10b6a800/lustre-MDT0000_UUID 00000020:00000080:3.0:1783135538.760428:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f10b6a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1783135538.760436:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1783135538.760507:0:12768:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1783135538.760511:0:12768:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1783135538.760514:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1783135538.760518:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135538.760520:0:12768:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00000080:1.0:1783135538.761857:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3db82800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1783135538.761869:0:38:0:(genops.c:906:class_export_put()) final put ffff8e8f2fcdf800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135538.761871:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f2fcdf800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1783135538.761879:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135538.762014:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c437800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783135538.762019:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8e03cf7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783135538.762026:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8e03cf1800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783135538.762031:0:38:0:(genops.c:906:class_export_put()) final put ffff8e8e03cf1000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135538.762033:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8e03cf1000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783135538.762039:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135538.762067:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3d10e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783135538.762072:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f2fcd9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783135538.762076:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3d108800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783135538.762081:0:38:0:(genops.c:906:class_export_put()) final put ffff8e8e0181b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135538.762097:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8e0181b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783135538.762101:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135538.762167:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3db81000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783135538.762172:0:38:0:(genops.c:906:class_export_put()) final put ffff8e8f2fcda800/lustre-MDD0000_UUID 00000020:00000080:1.0:1783135538.762174:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f2fcda800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783135538.762178:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783135538.762337:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3db85800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:3.0:1783135538.763631:0:12768:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff8e8f10b83800 b7b3a5dd-de38-42b7-b490-f49d65d3ab7a 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135538.763645:0:12768:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff8e8f09d08000) has exports, disconnecting them 00000020:00080000:3.0:1783135538.763650:0:12768:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8e8f10b83800), last request at 1783135303 00000020:00000080:3.0:1783135538.763676:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c5d8 00000020:00010000:3.0:1783135538.763684:0:12768:0:(genops.c:1942:obd_stale_export_put()) Put export ffff8e8f10b83800: total 0 00000100:00080000:3.0:1783135538.763689:0:12768:0:(import.c:65:import_set_state_nolock()) ffff8e8f10b86800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1783135538.763737:0:12768:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8f10b83800): rc 0 00000020:00080000:3.0:1783135538.763744:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff8e8f09d08000) has no exports 00000100:00100000:3.0:1783135538.763845:0:5788:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8e8f10a73000:5788] 1 exiting: rc = 0 00000020:00010000:0.0:1783135538.763861:0:5784:0:(genops.c:1928:obd_stale_export_get()) Get export ffff8e8f10b83800: total 0 00010000:00010000:0.0:1783135538.763911:0:5784:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff8e8f10b83800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1783135538.763944:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f0121cc00/0xf646e0cda875cb1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875cb18 expref: 9 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135538.763961:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c486000/0xf646e0cda875cb2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875cb26 expref: 8 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135538.763976:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f00030800/0xf646e0cda875c6f0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c6e9 expref: 7 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135538.763989:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42157600/0xf646e0cda875c92e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c927 expref: 6 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135538.764002:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b2600/0xf646e0cda875c8e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c8e1 expref: 5 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135538.764006:0:5787:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8e8f10a76c00:5787] 0 exiting: rc = 1 00010000:00010000:0.0:1783135538.764015:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42157a00/0xf646e0cda875c8da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c8d3 expref: 4 pid: 5788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135538.764029:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487400/0xf646e0cda875c8f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c8ef expref: 3 pid: 5787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135538.764038:0:5789:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8e8f10a77a00:5789] 2 exiting: rc = 0 00010000:00010000:0.0:1783135538.764041:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f42156200/0xf646e0cda875c904 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xf646e0cda875c8fd expref: 2 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135538.764058:0:5784:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff8e8f10b83800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1783135538.764073:0:5784:0:(genops.c:906:class_export_put()) final put ffff8e8f10b83800/b7b3a5dd-de38-42b7-b490-f49d65d3ab7a 00000100:00100000:3.0:1783135538.764079:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764089:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1783135538.764090:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135538.764092:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135538.764099:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1783135538.764101:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135538.764109:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783135538.764110:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f10b83800/b7b3a5dd-de38-42b7-b490-f49d65d3ab7a for MGS 00000100:00100000:3.0:1783135538.764115:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764120:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764126:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764133:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764141:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764148:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764154:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783135538.764157:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f10b86800 for MGS 00000100:00100000:3.0:1783135538.764173:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764180:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764188:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764194:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764201:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764207:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764216:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764223:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764232:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764239:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764247:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764253:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764260:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764269:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764278:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764285:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764292:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764299:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764305:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764321:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764329:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764337:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764345:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764352:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764359:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764366:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764374:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764381:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764389:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764397:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764409:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764419:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764427:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764436:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764442:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764447:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764452:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764457:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764472:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764479:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764485:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764491:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764496:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764502:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764508:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764513:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764519:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764537:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764542:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764548:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764553:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764559:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.764564:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1783135538.764981:0:12768:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783135538.764991:0:12768:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1783135538.767735:0:12768:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8f17fe41e0 - data ffff8e8f37f74d80/ffff8e8f3d8b2c00 00000020:01000000:3.0:1783135538.768190:0:12768:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8f1054a9c0 - data ffff8e8f1dc41798/ffff8e8f10b8bc00 00000020:00000080:3.0:1783135538.768729:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c5bc 00000020:00000080:3.0:1783135538.768736:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f0aafc000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1783135538.768757:0:12768:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8f063e9800 from MGS, refs=2 00000020:01000004:3.0:1783135538.768762:0:12768:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8f063e9800 2 00000020:01000004:3.0:1783135538.768766:0:12768:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8f063e9800 from MGS 00000020:00000080:3.0:1783135538.768789:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135538.768796:0:12768:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1783135538.768799:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f0aaf9000/MGS 00000020:00000080:3.0:1783135538.768802:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f0aaf9000/MGS for MGS 00000020:01000000:3.0:1783135538.768808:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1783135538.769025:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f0aafc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1783135538.769347:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1783135538.769354:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135538.769361:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1783135538.769371:0:12768:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8e8f2fd42800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1783135538.769377:0:12768:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff8e8f062a4d40) has exports, disconnecting them 00000020:00080000:3.0:1783135538.769382:0:12768:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8e8f2fd42800), last request at 1783135304 00000020:00000080:3.0:1783135538.769386:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c687 00000020:00080000:3.0:1783135538.769398:0:12768:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8f2fd42800): rc 0 00000020:00000080:3.0:1783135538.769402:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f2fd42800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783135538.773595:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f2fd42800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:3.0:1783135538.819706:0:12768:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:3.0:1783135538.819717:0:12768:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783135538.819722:0:12768:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783135538.819729:0:12768:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783135538.819968:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f2fd44800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1783135538.820092:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135538.820102:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1783135538.820109:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f2fd40000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1783135538.820113:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f2fd40000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1783135538.820119:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1783135538.820207:0:12768:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8f063e9800 1 00000020:00000080:3.0:1783135538.820559:0:12768:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c5ae 00000020:00000080:3.0:1783135538.820569:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f0aafe800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1783135538.820619:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1783135538.820624:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783135538.820629:0:12768:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783135538.820633:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff8e8f062a3380) has no exports 00000020:00000080:1.0:1783135538.827269:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f0aafe800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783135538.924092:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135538.924117:0:12768:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1783135538.924125:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f063ec800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1783135538.924132:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f063ec800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1783135538.924151:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1783135538.924293:0:12768:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8e8f063eb000 00000020:01000000:0.0:1783135538.924327:0:12768:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1783135538.924332:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135538.924336:0:12768:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783135538.924340:0:12768:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff8e8f10b60000) has no exports 00000100:00100000:2.0:1783135538.924863:0:5794:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8e8f0572e200:5794] 0 exiting: rc = 1 00000100:00100000:2.0:1783135538.925107:0:5796:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8e8f053dda00:5796] 2 exiting: rc = 0 00000100:00100000:3.0:1783135538.926622:0:9499:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8e8f394d4e00:9499] 3 exiting: rc = 0 00000100:00100000:3.0:1783135538.927674:0:5795:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8e8f10b3d800:5795] 1 exiting: rc = 0 00000100:00100000:0.0:1783135538.938987:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.938999:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939005:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939011:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939017:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939023:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939028:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939033:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939039:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939197:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939206:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939211:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939216:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939223:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939229:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939235:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939241:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939246:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939251:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939257:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939263:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939286:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939292:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939297:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939302:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939307:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939313:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939318:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939324:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939330:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939336:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939341:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939346:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939352:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939358:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939363:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939368:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939374:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939378:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939383:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939388:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939394:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939399:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939404:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939409:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939414:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939421:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939427:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939435:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939441:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939446:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939451:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939457:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939462:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939469:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939475:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939488:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939494:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939499:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939505:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939510:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939516:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939551:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.939559:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.953326:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8e8f053dc600:5798] 1 exiting: rc = 0 00000100:00100000:0.0:1783135538.953438:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8e8f053ddc00:5797] 0 exiting: rc = 1 00000100:00100000:1.0:1783135538.953550:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953560:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953567:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953576:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953583:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953590:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953597:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953612:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953622:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953628:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953635:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953642:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953654:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953662:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953674:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953684:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953695:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953704:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953709:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953739:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953990:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.953998:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954004:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954010:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954016:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954021:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954027:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954032:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954037:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954043:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954240:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954246:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954253:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954259:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954265:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954272:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954278:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954289:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954297:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954306:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954313:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954324:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954336:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954344:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954351:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954362:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954368:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954373:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954379:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954391:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954430:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954436:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954463:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954469:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954483:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954489:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954494:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954500:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954505:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954511:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954516:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954531:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954538:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.954550:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.955419:0:5800:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8e8f26380600:5800] 1 exiting: rc = 0 00000100:00100000:3.0:1783135538.955550:0:5799:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8e8f0572e000:5799] 0 exiting: rc = 1 00000100:00100000:1.0:1783135538.955638:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955645:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955653:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955696:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955737:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955748:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955761:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955769:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955778:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955787:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955795:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955803:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955811:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955856:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955867:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955876:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955902:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955909:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955916:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955922:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955929:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955934:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955941:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955947:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955953:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.955972:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956187:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956199:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956231:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956243:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956251:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956257:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956265:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956273:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956281:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956288:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956296:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956303:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956311:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956318:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956357:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956366:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956372:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956383:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956391:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956397:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956403:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956409:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956415:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956421:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956426:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956431:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956486:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956495:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956500:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956505:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956511:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956518:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956533:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956538:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956552:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956558:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956563:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.956576:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.975102:0:5801:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8e8f26381200:5801] 0 exiting: rc = 1 00000100:00100000:3.0:1783135538.975245:0:5802:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8e8f26381400:5802] 1 exiting: rc = 0 00000100:00100000:1.0:1783135538.975310:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975317:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975323:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975328:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975344:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975349:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975358:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975363:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975368:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975372:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975377:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975381:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975386:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975390:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975394:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975399:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975404:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975408:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975412:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975417:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975422:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975426:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975432:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975437:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975442:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975446:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975451:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975456:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975460:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975464:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975468:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975485:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975490:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975494:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975499:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975512:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975517:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975530:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975535:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975539:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975544:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975549:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975554:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975558:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975563:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975566:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975572:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975578:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975583:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975588:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975592:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975597:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975602:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975607:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975612:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975617:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975621:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975625:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975630:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975635:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975639:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975643:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975648:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.975653:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.976247:0:5804:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8e8f26381800:5804] 1 exiting: rc = 0 00000100:00100000:2.0:1783135538.982852:0:5803:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8e8f264ee800:5803] 0 exiting: rc = 1 00000100:00100000:0.0:1783135538.987378:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987391:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987398:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987407:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987414:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987421:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987429:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987435:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987442:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987449:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987456:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987461:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987466:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987473:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987479:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987485:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987491:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987497:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987504:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987512:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987518:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987540:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987560:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987571:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.987577:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991014:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991038:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991592:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991604:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991613:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991620:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991628:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991636:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991644:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991653:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991661:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991671:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991678:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991685:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991691:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991698:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991707:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991714:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991722:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991731:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991738:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991746:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991753:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991760:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991772:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991782:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991793:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991798:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.991810:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992461:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992469:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992480:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992515:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992533:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992541:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992548:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992554:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992560:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135538.992566:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135538.994536:0:5806:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8e8f26382600:5806] 1 exiting: rc = 0 00000100:00100000:0.0:1783135538.996109:0:5805:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8e8f26383c00:5805] 0 exiting: rc = 1 00000100:00100000:1.0:1783135538.998074:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998088:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998113:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998120:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998128:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998135:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998143:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998152:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998160:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998168:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998175:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998184:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998194:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998203:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998210:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998219:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998229:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998239:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998246:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998251:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998256:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998261:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998266:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998271:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998276:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998282:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998289:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998295:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998302:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998307:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998313:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998318:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998322:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998329:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998337:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998344:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998352:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998370:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998376:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998382:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998518:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998535:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998541:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998546:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998552:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998556:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998563:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998568:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998574:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998579:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998586:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998592:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998598:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998603:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998608:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998615:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998621:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998625:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998630:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998635:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998640:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998645:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998651:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135538.998656:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783135539.006464:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8e8f26444e00:5808] 1 exiting: rc = 0 00000100:00100000:3.0:1783135539.007445:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8e8f26383400:5809] 2 exiting: rc = 0 00000100:00100000:1.0:1783135539.022790:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8e8f2fd65600:5807] 0 exiting: rc = 1 00000100:00100000:0.0:1783135539.027065:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027077:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027084:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027090:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027099:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027105:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027111:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027117:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027124:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027130:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027136:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027141:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027191:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027199:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027207:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027212:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027223:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027228:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027233:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027240:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027246:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027252:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027258:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027263:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027269:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027276:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027282:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027307:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027313:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027320:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027326:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027332:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027339:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027346:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027353:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027360:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027382:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027389:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027396:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027401:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027406:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027411:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027417:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027423:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027429:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027434:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027440:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027445:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027450:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027455:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027461:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027467:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027473:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027479:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027486:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027492:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027497:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027935:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027948:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027954:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027960:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027966:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027984:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135539.027990:0:12768:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783135539.037249:0:12768:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135539.037263:0:12768:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1783135539.037270:0:12768:0:(genops.c:906:class_export_put()) final put ffff8e8f10b6e000/MDS_uuid 00000020:00000080:1.0:1783135539.037275:0:12768:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f10b6e000/MDS_uuid for MDS 00000020:01000000:1.0:1783135539.037281:0:12768:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1783135539.037486:0:12768:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1783135539.132192:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135539.333018:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135539.333056:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813311360:0@lo:400:kworker.0 00000400:00000100:2.0:1783135539.333121:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752813311360 offset 0 length 224: 4 00000100:00100000:2.0:1783135539.333198:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813311488:0@lo:400:kworker.0 00000400:00000100:2.0:1783135539.333219:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752813311488 offset 0 length 224: 4 00000100:00100000:2.0:1783135539.333263:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813311616:0@lo:400:kworker.0 00000400:00000100:2.0:1783135539.333281:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752813311616 offset 0 length 224: 4 00000001:00100000:2.0:1783135539.988888:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1783135539.988903:0:7494:0:(genops.c:906:class_export_put()) final put ffff8e8f3c431800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783135539.989850:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c431800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1783135539.989954:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3c433800 for lustre-OST0001 00010000:00010000:1.0:1783135540.155346:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135541.180694:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135542.202590:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783135542.696237:0:12923:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1783135542.726020:0:12923:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1783135542.726091:0:12923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135542.726109:0:12923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135542.726117:0:12923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135542.726123:0:12923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135542.726145:0:12923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1783135542.726153:0:12923:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1783135542.726185:0:12923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135542.726200:0:12923:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8f3c049500 x1869752813311488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135555 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135542.726240:0:12923:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:2.0:1783135542.726284:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813311488:0@lo:400:kworker.0 00000100:00080000:2.0:1783135542.726338:0:12923:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783135542.726371:0:12923:0:(import.c:65:import_set_state_nolock()) ffff8e8e01828000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1783135542.727992:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135542.728010:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135542.728024:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f42157200 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135542.728029:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135542.728041:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135542.728050:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135542.728058:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135542.728061:0:5783:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1783135542.728064:0:5783:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1783135542.728109:0:5783:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135542.728116:0:5783:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135542.728148:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135542.728155:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f42157200/0xf646e0cda875c8ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xf646e0cda875c8f6 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135542.728169:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135542.728187:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135542.728189:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135542.728215:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1869752813311744:0@lo:39:umount.0 00000400:00000100:1.0:1783135542.728307:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752813311744 offset 0 length 224: 4 00000100:00100000:1.0:1783135542.728513:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813311872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135542.728573:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135542.728634:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813311872 00000100:00100000:1.0:1783135542.728645:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813311872 00000100:00100000:1.0:1783135542.728708:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135542.728719:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03333b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1869752813311872:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1783135542.728727:0:6604:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783135542 with bad export cookie 17746118555599226328 00000100:00080000:2.0:1783135542.748663:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1783135542.748674:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e8f0aafe000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1783135542.748681:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:1.0:1783135542.751069:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03333b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3312:x1869752813311872:12345-0@lo:103:ldlm_bl.0 Request processed in 22334us (22481us total) trans 0 rc -107/-107 00000100:00100000:1.0:1783135542.751089:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1783135542.759686:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.160@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1783135542.759696:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1783135542.759711:0:3312:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8f3c048380 x1869752813311360/t0(0) o400->MGC192.168.201.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783135555 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135542.759804:0:3312:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8e03333100 x1869752813311872/t0(0) o103->MGC192.168.201.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783135558 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1783135542.759844:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1783135542.759848:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1783135542.759850:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1783135542.759854:0:3312:0:(import.c:65:import_set_state_nolock()) ffff8e8f0aafe000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135542.759860:0:3312:0:(import.c:512:import_select_connection()) MGC192.168.201.160@tcp: connect to NID 0@lo last attempt 203 00000100:00080000:2.0:1783135542.759871:0:3312:0:(import.c:626:import_select_connection()) MGC192.168.201.160@tcp: import ffff8e8f0aafe000 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:2.0:1783135542.759924:0:3312:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f3c04b100 x1869752813312000/t0(0) o250->MGC192.168.201.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135542.759968:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3312:1869752813311872:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135542.760532:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3314:1869752813311360:0@lo:400:kworker.0 00000100:00100000:1.0:1783135542.760656:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3310:1869752813312000:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1783135542.760739:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752813312000 offset 0 length 520: 4 00010000:00010000:1.0:1783135543.226517:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135544.250320:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783135544.443354:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135544.443368:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135544.443478:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135544.447345:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1869752813312128:0@lo:400:kworker.0 00000400:00000100:2.0:1783135544.447447:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752813312128 offset 0 length 224: 4 00010000:00010000:1.0:1783135545.274521:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135546.298079:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135547.322527:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135548.348087:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135548.474209:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1783135548.474225:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135548.474396:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1869752813312256:0@lo:400:kworker.0 00000400:00000100:2.0:1783135548.474479:0:3314:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752813312256 offset 0 length 224: 4 00010000:00010000:0.0:1783135549.373170:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135550.394382:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135551.421206:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135552.122032:0:3310:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135542/real 1783135542] req@ffff8e8f3c04b100 x1869752813312000/t0(0) o250->MGC192.168.201.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135552 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135552.122115:0:3310:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8f3c04b100 x1869752813312000/t0(0) o250->MGC192.168.201.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1783135552 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135552.122129:0:3310:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135542/real 1783135542] req@ffff8e8f3c049500 x1869752813311744/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135552 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135552.122144:0:3310:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8f3c049500 x1869752813311744/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135552 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135552.122169:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f0aafe000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135552.122216:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1783135552.122221:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3310:1869752813312000:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1783135552.122229:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8e01828000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1783135552.122254:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1869752813311744:0@lo:39:umount.0 00000100:00080000:3.0:1783135552.122619:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783135552.122626:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1783135552.122630:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e8f0aafe000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783135552.122637:0:38:0:(import.c:512:import_select_connection()) MGC192.168.201.160@tcp: connect to NID 0@lo last attempt 442 00000100:00080000:3.0:1783135552.122643:0:38:0:(import.c:591:import_select_connection()) MGC192.168.201.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1783135552.122654:0:38:0:(import.c:626:import_select_connection()) MGC192.168.201.160@tcp: import ffff8e8f0aafe000 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:3.0:1783135552.122712:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8e026e6d80 x1869752813312384/t0(0) o250->MGC192.168.201.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135552.122783:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3310:1869752813312384:0@lo:250:kworker.0 00000400:00000100:1.0:1783135552.122881:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869752813312384 offset 0 length 520: 4 00000100:00080000:2.0:1783135552.123059:0:12923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135552.123066:0:12923:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1783135552.123073:0:12923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:3.0:1783135552.123490:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813312512:0@lo:400:kworker.0 00000400:00000100:3.0:1783135552.123541:0:3311:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752813312512 offset 0 length 224: 4 00010000:00010000:2.0:1783135552.129187:0:12923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135552.129227:0:12923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135552.133048:0:12923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135552.133065:0:12923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135552.133101:0:12923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135552.133118:0:12923:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135552.133127:0:12923:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135552.133135:0:12923:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135552.133142:0:12923:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135552.133186:0:12923:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1783135552.133207:0:12923:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1783135552.133489:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135552.133498:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135552.133507:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3600 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135552.133512:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135552.133523:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135552.133532:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135552.133539:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135552.133543:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1783135552.133546:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1783135552.133567:0:5784:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8f0aafe000 00010000:00010000:3.0:1783135552.133572:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135552.133579:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875c8fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875c904 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135552.133599:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135552.133602:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135552.133608:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3800 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135552.133610:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135552.133626:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135552.133632:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135552.133638:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783135552.133641:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783135552.133643:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783135552.133649:0:5784:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8f0aafe000 00010000:00010000:3.0:1783135552.133652:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783135552.133734:0:12923:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1783135552.133740:0:12923:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1783135552.133748:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135552.133755:0:12923:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783135552.133761:0:12923:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8e8f37c48000) has no exports 00000020:00080000:2.0:1783135552.133798:0:12923:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff8e8f37c48000) has no exports 00010000:00010000:3.0:1783135552.134396:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875cb26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875cb2d expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135552.134413:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135552.134415:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135552.134418:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135552.134496:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1783135552.140144:0:12923:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8f106ae780 - data ffff8e8f2d3caca8/ffff8e8f37bbc000 00000020:01000000:2.0:1783135552.140420:0:12923:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8f0628bd80 - data ffff8e8f1dc3b510/ffff8e8e01832800 00100000:10000000:2.0:1783135552.148568:0:12923:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783135552.197191:0:12923:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c70c 00000020:00000080:2.0:1783135552.197207:0:12923:0:(genops.c:906:class_export_put()) final put ffff8e8f37beb000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783135552.197231:0:12923:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8f04f38800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783135552.197236:0:12923:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8f04f38800 2 00000020:01000004:2.0:1783135552.197240:0:12923:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8f04f38800 from lustre-OST0000 00000020:00000080:2.0:1783135552.197278:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135552.197302:0:12923:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1783135552.197305:0:12923:0:(genops.c:906:class_export_put()) final put ffff8e8f37be9800/lustre-OST0000_UUID 00000020:00000080:2.0:1783135552.197309:0:12923:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f37be9800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783135552.197317:0:12923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1783135552.197373:0:12923:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1783135552.197379:0:12923:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783135552.197383:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135552.197389:0:12923:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783135552.197399:0:12923:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8e8f37c41800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783135552.197405:0:12923:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff8e8f3fc319c0) has exports, disconnecting them 00000020:00080000:2.0:1783135552.197411:0:12923:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8e8f37c41800), last request at 1783135321 00000020:00000080:2.0:1783135552.197438:0:12923:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c736 00000020:00080000:2.0:1783135552.197450:0:12923:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8f37c41800): rc 0 00000020:00000080:2.0:1783135552.197455:0:12923:0:(genops.c:906:class_export_put()) final put ffff8e8f37c41800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1783135552.197804:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f37beb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783135552.197833:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f37c41800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1783135552.234810:0:12923:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1783135552.234999:0:12923:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783135552.235005:0:12923:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783135552.235017:0:12923:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783135552.235280:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8e01828000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1783135552.235359:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135552.235378:0:12923:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1783135552.235393:0:12923:0:(genops.c:906:class_export_put()) final put ffff8e8e01829000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1783135552.235399:0:12923:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8e01829000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1783135552.235412:0:12923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1783135552.235486:0:12923:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8f04f38800 1 00000020:00000080:2.0:1783135552.238088:0:12923:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c6c6 00000020:00000080:2.0:1783135552.238105:0:12923:0:(genops.c:906:class_export_put()) final put ffff8e8f3c275000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1783135552.238135:0:12923:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1783135552.238329:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c275000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1783135552.238379:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135552.238394:0:12923:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783135552.238400:0:12923:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff8e8f062a0000) has no exports 00000020:00000080:3.0:1783135552.282423:0:12923:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783135552.282446:0:12923:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783135552.282454:0:12923:0:(genops.c:906:class_export_put()) final put ffff8e8f04f3f000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783135552.282460:0:12923:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f04f3f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783135552.282473:0:12923:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783135552.285915:0:12923:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8e8f04f3c800 00000020:02000400:3.0:1783135552.286006:0:12923:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1783135552.445860:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135553.472964:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135554.495930:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1783135555.196723:0:3311:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135539/real 1783135539] req@ffff8e8f3c04a300 x1869752813311616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135555 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135555.245049:0:3311:0:(client.c:2533:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8e8f3c04a300 x1869752813311616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1783135555 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135555.246718:0:3311:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c430800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783135555.246725:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1783135555.266930:0:3311:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1783135555.267329:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135555.267337:0:38:0:(pinger.c:249:ptlrpc_pinger_process_import()) b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135555.267340:0:38:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783135555.267343:0:38:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783135555.267348:0:38:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c430800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135555.267356:0:38:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 239 00000100:00080000:0.0:1783135555.267365:0:38:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8f3c430800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:0.0:1783135555.267407:0:38:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f3c3dca80 x1869752813312640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783135555.267486:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813311616:0@lo:400:kworker.0 00000100:00100000:1.0:1783135555.267612:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1869752813312640:0@lo:38:kworker.0 00000400:00000100:1.0:1783135555.267676:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869752813312640 offset 0 length 520: 4 00000020:01000004:1.0:1783135555.361258:0:13075:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783135555.377106:0:13075:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1783135555.377202:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.377225:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.377233:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.377249:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.377270:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783135555.377277:0:13075:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783135555.377298:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135555.377311:0:13075:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8e026e5180 x1869752813312128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135560 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135555.377332:0:13075:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8e03330700 x1869752813312256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135564 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135555.377341:0:13075:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8e026e5500 x1869752813312512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135568 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135555.377357:0:13075:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8f3c3dca80 x1869752813312640/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783135565 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135555.377371:0:13075:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783135555.377404:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c430800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135555.377410:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:1.0:1783135555.377430:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1869752813312640:0@lo:38:kworker.0 00000100:00080000:1.0:1783135555.377461:0:13075:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783135555.377467:0:13075:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c430800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1783135555.377472:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783135555.377476:0:13075:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8e026e5180 x1869752813312128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135560 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135555.377484:0:13075:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8e03330700 x1869752813312256/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135564 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135555.377491:0:13075:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8e026e5500 x1869752813312512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135568 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135555.377498:0:13075:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783135555.377501:0:13075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1783135555.377572:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813312512:0@lo:400:kworker.0 00010000:00010000:3.0:1783135555.377696:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135555.377703:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135555.377720:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05220400 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:3.0:1783135555.377724:0:5783:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135555.377734:0:5783:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783135555.377740:0:5783:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135555.377746:0:5783:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783135555.377749:0:5783:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1783135555.377751:0:5783:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1783135555.377764:0:5783:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8f0aafe000 00010000:00010000:3.0:1783135555.377768:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135555.377775:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05220400/0xf646e0cda875c8d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875c8da expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135555.377785:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135555.377787:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135555.377789:0:5783:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135555.377943:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1869752813312256:0@lo:400:kworker.0 00000100:00100000:2.0:1783135555.377960:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1869752813312128:0@lo:400:kworker.0 00010000:00010000:1.0:1783135555.379656:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.379676:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.379683:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.379689:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.379717:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135555.379725:0:13075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.379732:0:13075:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.379750:0:13075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.379755:0:13075:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.379779:0:13075:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783135555.379786:0:13075:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1783135555.379808:0:13075:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1783135555.379860:0:13075:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1783135555.379867:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135555.379874:0:13075:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783135555.379877:0:13075:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8e8f3fc30000) has no exports 00000020:00080000:1.0:1783135555.379904:0:13075:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff8e8f3fc30000) has no exports 00010000:00010000:0.0:1783135555.381600:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135555.381611:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135555.381622:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486c00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:0.0:1783135555.381626:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135555.381637:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135555.381645:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135555.381651:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783135555.381653:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1783135555.381656:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1783135555.381670:0:5784:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8f0aafe000 00010000:00010000:0.0:1783135555.381674:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135555.381681:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486c00/0xf646e0cda875c8e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875c8e8 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135555.381693:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135555.381697:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135555.381721:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f05221000 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:0.0:1783135555.381727:0:5784:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135555.381734:0:5784:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135555.381743:0:5784:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135555.381750:0:5784:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1783135555.381752:0:5784:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1783135555.381756:0:5784:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1783135555.381760:0:5784:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8f0aafe000 00010000:00010000:0.0:1783135555.381763:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135555.381774:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05221000/0xf646e0cda875cb18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875cb1f expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135555.381786:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135555.381790:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135555.381792:0:5784:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135555.383084:0:6603:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1783135555.384303:0:13075:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8f106ae5a0 - data ffff8e8f1dc2e510/ffff8e8f37bbdc00 00000020:01000000:1.0:1783135555.384502:0:13075:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff8e8f37b4ed80 - data ffff8e8f2d3c80d8/ffff8e8f37c13400 00100000:10000000:1.0:1783135555.400566:0:13075:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1783135555.421250:0:13075:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c7d7 00000020:00000080:1.0:1783135555.421261:0:13075:0:(genops.c:906:class_export_put()) final put ffff8e8f3c6f4000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1783135555.421281:0:13075:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8e0182b800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1783135555.421286:0:13075:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8e0182b800 2 00000020:01000004:1.0:1783135555.421290:0:13075:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8e8e0182b800 from lustre-OST0001 00000020:00000080:1.0:1783135555.421314:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135555.421326:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1783135555.421330:0:13075:0:(genops.c:906:class_export_put()) final put ffff8e8f2fd4c800/lustre-OST0001_UUID 00000020:00000080:1.0:1783135555.421333:0:13075:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f2fd4c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1783135555.421341:0:13075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1783135555.421549:0:13075:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import b7b3a5dd-de38-42b7-b490-f49d65d3ab7a->MGS 00010000:00010000:1.0:1783135555.421566:0:13075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c6f0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135555.421588:0:13075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c6f0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135555.421602:0:13075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1783135555.421605:0:13075:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1783135555.421608:0:13075:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1783135555.421624:0:13075:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8f0aafe000 00010000:00010000:1.0:1783135555.421628:0:13075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f029c8000/0xf646e0cda875c6e9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875c6f0 expref: -99 pid: 6585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135555.421646:0:13075:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xf646e0cda875c92e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135555.421653:0:13075:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xf646e0cda875c92e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135555.421665:0:13075:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783135555.421667:0:13075:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1783135555.421669:0:13075:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1783135555.421679:0:13075:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8e8f0aafe000 00010000:00010000:1.0:1783135555.421682:0:13075:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f05220000/0xf646e0cda875c927 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xf646e0cda875c92e expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783135555.421698:0:13075:0:(import.c:65:import_set_state_nolock()) ffff8e8f0aafe000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1783135555.421775:0:13075:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1783135555.421781:0:13075:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1783135555.421782:0:13075:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1783135555.421786:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1783135555.421903:0:13075:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff8e8e026e6d80 x1869752813312384/t0(0) o250->MGC192.168.201.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783135567 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1783135555.421952:0:13075:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1783135555.421956:0:13075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000020:00000080:0.0:1783135555.422982:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c6f4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1783135555.425096:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b7b3a5dd-de38-42b7-b490-f49d65d3ab7a:3310:1869752813312384:0@lo:250:kworker.0 10000000:01000000:1.0:1783135555.425211:0:13075:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1783135555.425227:0:13075:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c5ca 00000020:00000080:1.0:1783135555.425248:0:13075:0:(genops.c:906:class_export_put()) final put ffff8e8f0576a000/b7b3a5dd-de38-42b7-b490-f49d65d3ab7a 00000020:01000000:1.0:1783135555.425277:0:13075:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.160@tcp (flags='') 00000020:00000080:1.0:1783135555.425288:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135555.425296:0:13075:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1783135555.425302:0:13075:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff8e8f062a19c0) has no exports 00000020:00000080:0.0:1783135555.425407:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f0576a000/b7b3a5dd-de38-42b7-b490-f49d65d3ab7a for MGC192.168.201.160@tcp 10000000:01000000:0.0:1783135555.425427:0:5791:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783135555.425508:0:13075:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.160@tcp: client import never connected 00000100:00080000:0.0:1783135555.425515:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783135555.425517:0:13075:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783135555.425637:0:13075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783135555.425640:0:13075:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783135555.425900:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783135555.425908:0:13075:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.160@tcp (uuid b7b3a5dd-de38-42b7-b490-f49d65d3ab7a) 00000020:01000000:0.0:1783135555.425914:0:13075:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783135555.425918:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783135555.425922:0:13075:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783135555.425928:0:13075:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8e8f3c436000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783135555.425933:0:13075:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff8e8f053919c0) has exports, disconnecting them 00000020:00080000:0.0:1783135555.425937:0:13075:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8e8f3c436000), last request at 1783135340 00000020:00000080:0.0:1783135555.425941:0:13075:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c801 00000020:00080000:0.0:1783135555.425952:0:13075:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff8e8f3c436000): rc 0 00000020:00000080:0.0:1783135555.425957:0:13075:0:(genops.c:906:class_export_put()) final put ffff8e8f3c436000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1783135555.428386:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f0aafe000 for MGC192.168.201.160@tcp 00000020:00000080:1.0:1783135555.428405:0:38:0:(genops.c:906:class_export_put()) final put ffff8e8f0576f000/b7b3a5dd-de38-42b7-b490-f49d65d3ab7a 00000020:00000080:1.0:1783135555.428410:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f0576f000/b7b3a5dd-de38-42b7-b490-f49d65d3ab7a for MGC192.168.201.160@tcp 00000020:01000000:1.0:1783135555.428419:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.160@tcp (b7b3a5dd-de38-42b7-b490-f49d65d3ab7a) 00000020:00000080:2.0:1783135555.431558:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c436000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1783135555.461652:0:13075:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1783135555.461663:0:13075:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783135555.461668:0:13075:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1783135555.461677:0:13075:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783135555.462066:0:5783:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1783135555.462277:0:5784:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1783135555.463475:0:6603:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1783135555.463808:0:7482:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8e8f3cbde600:7482] 2 exiting: rc = 0 00000020:00000080:2.0:1783135555.464054:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff8e8f3c430800 for lustre-MDT0000-lwp-OST0001 00000100:00100000:2.0:1783135555.464101:0:5778:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8e8f09066c00:5778] 0 exiting: rc = 1 00000100:00100000:3.0:1783135555.464225:0:5779:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8e8f09067600:5779] 1 exiting: rc = 0 00000100:00100000:0.0:1783135555.467320:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.467864:0:6604:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8e8f37b8a200:6604] 3 exiting: rc = 0 00000100:00100000:2.0:1783135555.467994:0:5782:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8e8f09067e00:5782] 2 exiting: rc = 0 00000100:00100000:2.0:1783135555.468038:0:5780:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8e8f1e13ae00:5780] 0 exiting: rc = 1 00000100:00100000:0.0:1783135555.468588:0:11521:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8e8f3cbde400:11521] 4 exiting: rc = 0 00000100:00100000:0.0:1783135555.468684:0:5781:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8e8f1e13aa00:5781] 1 exiting: rc = 0 00000100:00100000:1.0:1783135555.469068:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469077:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469084:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469091:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469097:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469104:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469109:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469116:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469122:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469128:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469133:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469139:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469144:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469151:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469175:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469181:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469188:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469194:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469199:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469205:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469210:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469215:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469221:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469226:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469241:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469248:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469253:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469259:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469263:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469267:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469272:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469277:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469282:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469287:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469292:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469297:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469303:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469308:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469313:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469319:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469324:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469330:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469336:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469342:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469348:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469353:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469359:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469364:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469369:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469382:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469388:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469393:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469399:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469404:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469411:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469416:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469422:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469427:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469432:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469437:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469441:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469446:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469451:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.469457:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1783135555.470916:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1783135555.470927:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1783135555.470933:0:13075:0:(genops.c:906:class_export_put()) final put ffff8e8f3d1e4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1783135555.470938:0:13075:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3d1e4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1783135555.470943:0:13075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1783135555.470982:0:13075:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8e0182b800 1 00000020:00000080:1.0:1783135555.470987:0:13075:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xf646e0cda875c7a6 00000020:00000080:1.0:1783135555.470993:0:13075:0:(genops.c:906:class_export_put()) final put ffff8e8f3d1e3000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1783135555.471005:0:13075:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1783135555.471009:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783135555.471013:0:13075:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1783135555.471017:0:13075:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff8e8f3fc34d40) has no exports 00000020:00000080:2.0:1783135555.471101:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3d1e3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783135555.485272:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135555.485300:0:13075:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783135555.485307:0:13075:0:(genops.c:906:class_export_put()) final put ffff8e8e0182b000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783135555.485312:0:13075:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8e0182b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783135555.485321:0:13075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783135555.485530:0:13075:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff8e8e0182d800 00000020:01000000:2.0:1783135555.485570:0:13075:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783135555.485574:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783135555.485579:0:13075:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783135555.485583:0:13075:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff8e8f05393380) has no exports 00000020:00000080:2.0:1783135555.485607:0:13075:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783135555.485614:0:13075:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783135555.485617:0:13075:0:(genops.c:906:class_export_put()) final put ffff8e8f3c270800/OSS_uuid 00000020:00000080:2.0:1783135555.485619:0:13075:0:(genops.c:865:class_export_destroy()) destroying export ffff8e8f3c270800/OSS_uuid for OSS 00000020:01000000:2.0:1783135555.485623:0:13075:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1783135555.485714:0:5790:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783135555.488312:0:6590:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8e8f05214000:6590] 2 exiting: rc = 0 00000100:00100000:1.0:1783135555.488414:0:8303:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8e8f3c8a2e00:8303] 3 exiting: rc = 0 00000100:00100000:1.0:1783135555.488476:0:6587:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8e8f04f44a00:6587] 0 exiting: rc = 1 00000100:00100000:3.0:1783135555.488610:0:6589:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8e8f05215a00:6589] 1 exiting: rc = 0 00000100:00100000:2.0:1783135555.488778:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488785:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488795:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488801:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488806:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488832:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488838:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488843:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488848:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488853:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488858:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488864:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488869:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488874:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488879:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488883:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488888:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488893:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488898:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488902:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488918:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488923:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488928:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488933:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488938:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488943:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488949:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488955:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488960:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488964:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488970:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488974:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488979:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488983:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488988:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488992:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.488997:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489001:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489005:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489010:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489015:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489020:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489025:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489030:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489035:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489040:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489045:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489050:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489054:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489059:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489064:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489069:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489073:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489077:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489082:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489091:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489096:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489101:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489106:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489112:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489116:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489121:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489126:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783135555.489131:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.492694:0:6592:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8e8f3cca2800:6592] 1 exiting: rc = 0 00000100:00100000:1.0:1783135555.493157:0:6591:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8e8f0568a600:6591] 0 exiting: rc = 1 00000100:00100000:0.0:1783135555.493259:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493269:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493274:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493279:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493284:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493289:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493294:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493299:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493317:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493322:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493327:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493332:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493337:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493342:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493347:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493352:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493357:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493362:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493368:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493373:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493378:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493383:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493387:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493392:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493397:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493402:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493407:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493413:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493418:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493424:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493428:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493433:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493438:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493442:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493447:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493452:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493457:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493462:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493468:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493474:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493480:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493486:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493496:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493510:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493515:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493520:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493525:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493531:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493547:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493553:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493559:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493563:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493568:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493573:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493578:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493583:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493589:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493594:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493600:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493606:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493612:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493618:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493623:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.493629:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.494695:0:6593:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8e8f3ceffa00:6593] 0 exiting: rc = 1 00000100:00100000:1.0:1783135555.494939:0:6595:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8e8f08a17e00:6595] 2 exiting: rc = 0 00000100:00100000:2.0:1783135555.498648:0:6594:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8e8f08a17400:6594] 1 exiting: rc = 0 00000100:00100000:0.0:1783135555.498939:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498948:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498955:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498962:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498969:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498975:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498981:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498987:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498993:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.498999:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499005:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499010:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499016:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499022:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499046:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499052:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499057:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499064:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499070:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499075:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499080:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499086:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499091:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499097:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499103:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499109:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499114:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499120:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499142:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499150:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499156:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499161:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499166:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499172:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499178:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499183:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499189:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499195:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499201:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499207:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499214:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499220:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499225:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499231:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499247:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499252:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499258:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499264:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499268:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499281:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499286:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499292:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499312:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499319:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499325:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499330:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499337:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499342:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499348:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499354:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499360:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499367:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499373:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783135555.499379:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.507686:0:6597:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8e8f338d0400:6597] 1 exiting: rc = 0 00000100:00100000:0.0:1783135555.507686:0:6596:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8e8f3cca3200:6596] 0 exiting: rc = 1 00000100:00100000:1.0:1783135555.508124:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508133:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508138:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508143:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508149:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508154:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508160:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508165:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508171:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508177:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508184:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508189:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508194:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508200:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508205:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508212:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508217:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508222:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508628:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508641:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508646:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508651:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508655:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508660:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508666:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508671:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508677:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508682:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508687:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508692:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508719:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508724:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508730:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508735:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508754:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508759:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508764:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508769:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508774:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508780:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508785:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508791:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508796:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508802:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508807:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508811:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508840:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508845:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508849:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508854:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508859:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508864:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508868:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508874:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508879:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508884:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508889:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508895:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508901:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508907:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508912:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508916:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508922:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.508927:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.511950:0:6599:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8e8f338d0000:6599] 1 exiting: rc = 0 00000100:00100000:0.0:1783135555.511950:0:6598:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8e8f338d0e00:6598] 0 exiting: rc = 1 00000100:00100000:1.0:1783135555.512080:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512095:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512108:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512115:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512134:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512140:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512147:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512153:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512160:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512172:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512179:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512185:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512192:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512199:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512219:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512243:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512251:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512258:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512264:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512270:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512276:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512281:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512287:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512294:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512311:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512318:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512347:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512356:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512362:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512370:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512377:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512383:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512389:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512394:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512401:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512407:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512413:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512419:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512439:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512451:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512457:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512464:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512471:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512478:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512485:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512491:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512498:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512504:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512510:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512517:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512683:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512692:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512698:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512704:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512713:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512720:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512729:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512736:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512743:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512749:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512756:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512763:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512785:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783135555.512800:0:13075:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:1.0:1783135555.534125:0:13075:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1783135575.069356:0:13693:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783135582.249314:0:14105:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135582.249319:0:14105:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783135582.249427:0:14105:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8f0aafe000 00000020:01000004:3.0:1783135582.249444:0:14105:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783135582.249452:0:14105:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783135582.249477:0:14105:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8e8f05394d40) 00000020:00000080:3.0:1783135582.249489:0:14105:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783135582.278964:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783135582.287482:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1783135582.288227:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 565: rc = 0 00100000:10000000:2.0:1783135582.288334:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 565: rc = 0 00100000:10000000:2.0:1783135582.288436:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 565: rc = 0 00100000:10000000:2.0:1783135582.288579:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 565: rc = 0 00100000:10000000:2.0:1783135582.288677:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 565: rc = 0 00100000:10000000:2.0:1783135582.289018:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783135582.289091:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 565: rc = 0 00100000:10000000:2.0:1783135582.289326:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 567: rc = 0 00100000:10000000:2.0:1783135582.291577:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 166: rc = 0 00100000:10000000:2.0:1783135582.291673:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 166: rc = 0 00100000:10000000:2.0:1783135582.293098:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 695: rc = 0 00100000:10000000:2.0:1783135582.293434:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 695: rc = 0 00100000:10000000:2.0:1783135582.293675:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 695: rc = 0 00100000:10000000:2.0:1783135582.296473:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 695: rc = 0 00100000:10000000:2.0:1783135582.296750:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 695: rc = 0 00100000:10000000:2.0:1783135582.298389:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 695: rc = 0 00100000:10000000:2.0:1783135582.298682:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 695: rc = 0 00100000:10000000:2.0:1783135582.300219:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 695: rc = 0 00100000:10000000:2.0:1783135582.300494:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 695: rc = 0 00100000:10000000:2.0:1783135582.300735:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 695: rc = 0 00100000:10000000:2.0:1783135582.303116:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 695: rc = 0 00100000:10000000:2.0:1783135582.303406:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 695: rc = 0 00100000:10000000:2.0:1783135582.304066:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 180: rc = 0 00100000:10000000:2.0:1783135582.304343:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 180: rc = 0 00100000:10000000:2.0:1783135582.304633:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 180: rc = 0 00100000:10000000:3.0:1783135582.309500:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 180: rc = 0 00100000:10000000:3.0:1783135582.309806:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 180: rc = 0 00100000:10000000:3.0:1783135582.310270:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 180: rc = 0 00100000:10000000:3.0:1783135582.310542:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 180: rc = 0 00100000:10000000:3.0:1783135582.310807:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 180: rc = 0 00100000:10000000:3.0:1783135582.311678:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 180: rc = 0 00100000:10000000:3.0:1783135582.313347:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 180: rc = 0 00100000:10000000:3.0:1783135582.313635:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 180: rc = 0 00100000:10000000:3.0:1783135582.314608:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 180: rc = 0 00100000:10000000:3.0:1783135582.318502:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 180: rc = 0 00100000:10000000:3.0:1783135582.318801:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 180: rc = 0 00100000:10000000:3.0:1783135582.319269:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 180: rc = 0 00100000:10000000:3.0:1783135582.319518:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 180: rc = 0 00100000:10000000:3.0:1783135582.319779:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 180: rc = 0 00100000:10000000:3.0:1783135582.320470:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 180: rc = 0 00100000:10000000:3.0:1783135582.320734:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 180: rc = 0 00100000:10000000:3.0:1783135582.321471:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 180: rc = 0 00100000:10000000:3.0:1783135582.321749:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 180: rc = 0 00100000:10000000:3.0:1783135582.322432:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 180: rc = 0 00100000:10000000:3.0:1783135582.322680:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 180: rc = 0 00100000:10000000:3.0:1783135582.323114:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 180: rc = 0 00100000:10000000:3.0:1783135582.323510:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 180: rc = 0 00100000:10000000:3.0:1783135582.323734:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 180: rc = 0 00100000:10000000:3.0:1783135582.324118:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 180: rc = 0 00100000:10000000:3.0:1783135582.324351:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 180: rc = 0 00100000:10000000:3.0:1783135582.324589:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 180: rc = 0 00100000:10000000:3.0:1783135582.326403:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 180: rc = 0 00100000:10000000:3.0:1783135582.326696:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 180: rc = 0 00100000:10000000:3.0:1783135582.327243:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 180: rc = 0 00100000:10000000:3.0:1783135582.327611:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 404: rc = 0 00100000:10000000:3.0:1783135582.329223:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1783135582.330171:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 399: rc = 0 00100000:10000000:3.0:1783135582.330458:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1783135582.330531:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 399: rc = 0 00100000:10000000:3.0:1783135582.330715:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1783135582.330795:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 399: rc = 0 00100000:10000000:3.0:1783135582.333164:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1783135582.333246:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 167: rc = 0 00100000:10000000:3.0:1783135582.335124:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1783135582.335226:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 167: rc = 0 00100000:10000000:3.0:1783135582.335444:0:14105:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1783135582.335517:0:14105:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 167: rc = 0 00000020:00000080:3.0:1783135582.335790:0:14105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783135582.335797:0:14105:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783135582.335806:0:14105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875d8cb 00000020:01000004:3.0:1783135582.335854:0:14105:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1783135582.335859:0:14105:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783135582.335865:0:14105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8f0aafe000 from MGS 00000020:01000004:3.0:1783135582.335869:0:14105:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783135582.335879:0:14105:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8e8f05390000) 00000020:00000080:3.0:1783135582.335889:0:14105:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783135582.335944:0:14105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8f0aafe000 from MGS, refs=2 00080000:01000000:3.0:1783135582.335956:0:14105:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783135582.335961:0:14105:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875d8d9 00000100:00100000:3.0:1783135582.336048:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783135582.336166:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783135582.336172:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1783135582.339889:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1783135582.339905:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1783135582.341261:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783135582.341450:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1783135582.341456:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783135582.342254:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783135582.342266:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1783135582.342665:0:14105:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1783135582.342671:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1783135582.345195:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135582.345202:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135582.345205:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135582.346372:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135582.346383:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135582.346385:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135582.347050:0:14105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1783135582.357213:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783135582.382848:0:14105:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1783135582.382870:0:14105:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783135582.382873:0:14105:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1783135582.395237:0:14114:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1783135582.395439:0:14105:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1783135582.395592:0:14105:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783135582.397500:0:14105:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1783135582.401573:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135582.402032:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1783135582.402040:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783135582.404015:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1783135582.404029:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1783135582.409168:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1783135582.409186:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:2.0:1783135582.420493:0:14119:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1783135582.420560:0:14105:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783135582.420585:0:14105:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.160@tcp' 00000020:01000004:3.0:1783135582.420587:0:14105:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783135582.420619:0:14105:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.160@tcp (typ=mgc) 00000020:00000080:3.0:1783135582.420718:0:14105:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.160@tcp (ffff8e8f05393380) 00000020:00000080:3.0:1783135582.420737:0:14105:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783135582.420882:0:14105:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8e03cf3800@MGC192.168.201.160@tcp: add connection 192.168.201.160@tcp at head 00010000:00010000:3.0:1783135582.421134:0:14105:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.160@tcp-0 is initialized 00000040:01000000:3.0:1783135582.421142:0:14105:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.160@tcp ctxt 1 is initialized 10000000:01000000:3.0:1783135582.423204:0:14120:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783135582.423307:0:14105:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.160@tcp (uuid 9769ae29-b6ca-42fe-978a-c41f2bd6dcc6) 00000020:00000080:2.0:1783135582.423386:0:14105:0:(genops.c:1406:class_connect()) connect: client 9769ae29-b6ca-42fe-978a-c41f2bd6dcc6, cookie 0xf646e0cda875d8e7 00000100:00080000:2.0:1783135582.423399:0:14105:0:(import.c:512:import_select_connection()) MGC192.168.201.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135582.423406:0:14105:0:(import.c:626:import_select_connection()) MGC192.168.201.160@tcp: import ffff8e8e03cf3800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:2.0:1783135582.423440:0:14105:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f3c04b480 x1869752813312768/t0(0) o250->MGC192.168.201.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135582.423470:0:14105:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 9769ae29-b6ca-42fe-978a-c41f2bd6dcc6->MGS 00000020:01000004:2.0:1783135582.423498:0:14105:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783135582.423503:0:14105:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783135582.423516:0:14105:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8e8f3fc34d40) 00000020:00000080:2.0:1783135582.423528:0:14105:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783135582.424247:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3310:1869752813312768:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783135582.425043:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.434099:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813312768 00000100:00100000:0.0:1783135582.434115:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813312768 00000100:00100000:0.0:1783135582.434171:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135582.434182:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3310:x1869752813312768:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783135582.434214:0:14116:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 9769ae29-b6ca-42fe-978a-c41f2bd6dcc6@0@lo t0 exp 0000000000000000 cur 481 last 0 00000020:00000080:0.0:1783135582.434247:0:14116:0:(genops.c:1406:class_connect()) connect: client 9769ae29-b6ca-42fe-978a-c41f2bd6dcc6, cookie 0xf646e0cda875d8f5 00000100:00080000:0.0:1783135582.434369:0:14116:0:(import.c:65:import_set_state_nolock()) ffff8e8f37af5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135582.434468:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+5:3310:x1869752813312768:12345-0@lo:250:mount.lustre.0 Request processed in 287us (9427us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.434483:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135582.436003:0:3310:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783135582.436027:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.160@tcp: connect to target with instance 0 00000100:00080000:3.0:1783135582.436039:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783135582.436045:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783135582.436050:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8e03cf3800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783135582.436054:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783135582.436084:0:3310:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783135582.436095:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3310:1869752813312768:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1783135582.442571:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135582.442744:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783135582.442751:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783135582.450758:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783135582.450782:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783135582.453161:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783135582.453174:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1783135582.455293:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135582.455476:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1783135582.455482:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1783135582.456636:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1783135582.456646:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783135582.521711:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135582.524344:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1783135582.524353:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1783135582.533552:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1783135582.533570:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783135582.536277:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135582.536464:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783135582.536471:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783135582.555725:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783135582.555852:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1783135582.556593:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135582.556771:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783135582.556777:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1783135582.567312:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1783135582.567332:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1783135582.568124:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135582.568296:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1783135582.568302:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783135582.568885:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783135582.568892:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783135582.606222:0:14105:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783135582.607617:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783135582.607626:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1783135582.614636:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1783135582.614651:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1783135582.619590:0:14105:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1783135582.619604:0:14105:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1783135582.620880:0:14105:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1783135582.620907:0:14105:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1783135582.620913:0:14105:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1783135582.621059:0:14105:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135582.621120:0:14105:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.160@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1783135582.621125:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135582.621127:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135582.621128:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135582.621129:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135582.621130:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135582.621132:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135582.621133:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135582.621134:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135582.621136:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135582.621138:0:14105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135582.621140:0:14105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1783135582.621142:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135582.621144:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135582.621145:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135582.621146:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135582.621153:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135582.621153:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135582.621154:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135582.621155:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135582.621156:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135582.621157:0:14105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135582.621182:0:14105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1783135582.621202:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813312896:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135582.621289:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135582.621349:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f394ddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.621535:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813312896 00000100:00100000:0.0:1783135582.621542:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813312896 00000100:00100000:0.0:1783135582.621584:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135582.621593:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+5:14105:x1869752813312896:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135582.621642:0:14118:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783135582.621646:0:14118:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783135582.621649:0:14118:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783135582.625739:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783135582.626249:0:14118:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1783135582.631310:0:14140:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1783135582.631319:0:14140:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1783135582.631385:0:14140:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1783135582.631427:0:14140:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1783135582.632915:0:14118:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783135582.632929:0:14118:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1783135582.644663:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+5:14105:x1869752813312896:12345-0@lo:253:mount.lustre.0 Request processed in 23060us (23363us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.644678:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135582.645047:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813312896:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135582.645076:0:14105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783135582.645079:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135582.645081:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135582.645082:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135582.645083:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135582.645085:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135582.645086:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135582.645087:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135582.645089:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135582.645091:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135582.645092:0:14105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783135582.645111:0:14105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8f0aafe000 from lustre-MDT0000 10000000:01000000:2.0:1783135582.645139:0:14105:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1783135582.645142:0:14105:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783135582.645148:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8e8f05393380 10000000:01000000:2.0:1783135582.645152:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135582.645159:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff8e8f05393380 from 1 10000000:01000000:2.0:1783135582.645162:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783135582.645203:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.645246:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.645257:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135582.645278:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135582.645321:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135582.645348:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05923180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.645756:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813313024 00000100:00100000:0.0:1783135582.645772:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813313024 00000100:00100000:0.0:1783135582.645849:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135582.645858:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+5:14105:x1869752813313024:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135582.645871:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135582.645886:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3d042e00/0xf646e0cda875d903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875d8fc expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.645922:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3d042e00/0xf646e0cda875d903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875d8fc expref: 6 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.645932:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3d042e00/0xf646e0cda875d903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d8fc expref: 6 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.645940:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042e00, rc 0) 00000100:00100000:0.0:1783135582.645985:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+6:14105:x1869752813313024:12345-0@lo:101:mount.lustre.0 Request processed in 127us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.645991:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135582.646213:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135582.646240:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.646250:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135582.646329:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135582.646360:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135582.646379:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05923180 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.646739:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813313152 00000100:00100000:0.0:1783135582.646744:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813313152 00000100:00100000:0.0:1783135582.646797:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135582.646805:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+6:14105:x1869752813313152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135582.647150:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+6:14105:x1869752813313152:12345-0@lo:501:mount.lustre.0 Request processed in 344us (788us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135582.647158:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135582.647434:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313152:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1783135582.647483:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783135582.647608:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.647617:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135582.647626:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8f0aafe000 10000000:01000000:3.0:1783135582.647632:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783135582.647636:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8e8f0aafe000 10000000:01000000:3.0:1783135582.647638:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1783135582.647641:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff8e8f0aafe000 from 1 10000000:01000000:3.0:1783135582.647644:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1783135582.647668:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487e00/0xf646e0cda875d90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.647676:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487e00/0xf646e0cda875d90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.647698:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487e00/0xf646e0cda875d90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135582.647714:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135582.647746:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.647872:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135582.657238:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813313280 00000100:00100000:1.0:1783135582.657256:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813313280 00000100:00100000:1.0:1783135582.657308:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783135582.657318:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+6:14105:x1869752813313280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135582.657348:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135582.657373:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121c800/0xf646e0cda875d911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875d90a expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.657404:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121c800/0xf646e0cda875d911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875d90a expref: 7 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.657416:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121c800/0xf646e0cda875d911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d90a expref: 7 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.657425:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c800, rc 0) 00000100:00100000:3.0:1783135582.657700:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135582.657723:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487e00/0xf646e0cda875d90a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d911 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.657733:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487e00/0xf646e0cda875d90a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875d911 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135582.657769:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1783135582.657781:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487e00/0xf646e0cda875d90a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d911 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.657789:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487e00/0xf646e0cda875d90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d911 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135582.657796:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1783135582.657801:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135582.657806:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8e8f0aafe000 10000000:01000000:3.0:1783135582.657809:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1783135582.657812:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1783135582.657838:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783135582.657872:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486800/0xf646e0cda875d918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.657894:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486800/0xf646e0cda875d918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.657902:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486800/0xf646e0cda875d918 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135582.657920:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313408:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135582.659019:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135582.659157:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813313408 00000100:00100000:2.0:1783135582.659166:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813313408 00000100:00100000:2.0:1783135582.659219:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135582.659238:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+8:14105:x1869752813313408:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135582.659253:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135582.659273:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f02c39800/0xf646e0cda875d91f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875d918 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.659316:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f02c39800/0xf646e0cda875d91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875d918 expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.659507:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f02c39800/0xf646e0cda875d91f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d918 expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.659516:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c39800, rc 0) 00000100:00100000:2.0:1783135582.659557:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14105:x1869752813313408:12345-0@lo:101:mount.lustre.0 Request processed in 321us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135582.659563:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783135582.659745:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135582.659778:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313408:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135582.659794:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486800/0xf646e0cda875d918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d91f expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.659802:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486800/0xf646e0cda875d918 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875d91f expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135582.660315:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135582.660443:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.660479:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135582.661187:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813313536 00000100:00100000:2.0:1783135582.661195:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813313536 00000100:00100000:0.0:1783135582.661724:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135582.661737:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14105:x1869752813313536:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135582.662412:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+10:14105:x1869752813313536:12345-0@lo:501:mount.lustre.0 Request processed in 676us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.662420:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135582.662724:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14105:x1869752813313280:12345-0@lo:101:mount.lustre.0 Request processed in 5405us (14975us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.662731:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135582.663195:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313536:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135582.663382:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135582.663443:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.663483:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.663619:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813313664 00000100:00100000:0.0:1783135582.663626:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813313664 00000100:00100000:0.0:1783135582.663667:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135582.663677:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14105:x1869752813313664:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135582.664311:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14105:x1869752813313664:12345-0@lo:503:mount.lustre.0 Request processed in 632us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.664475:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135582.664614:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813313664:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135582.674850:0:14141:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14141:1869752813313792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135582.674940:0:14141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.675049:0:14141:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3cf2dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135582.677638:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813313792 00000100:00100000:1.0:1783135582.677655:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813313792 00000100:00100000:0.0:1783135582.680598:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135582.680614:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14141:x1869752813313792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135582.681939:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14141:x1869752813313792:12345-0@lo:502:llog_process_th.0 Request processed in 1322us (6991us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.681951:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783135582.682191:0:14141:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14141:1869752813313792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135582.682245:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135582.682257:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.682259:0:14141:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783135582.682264:0:14141:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1783135582.682267:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135582.682281:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8e8f053919c0) 00000020:00000080:3.0:1783135582.682301:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1783135582.682306:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1783135582.682665:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:3.0:1783135582.682673:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875d92d 00000020:00000080:3.0:1783135582.682939:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1783135582.682944:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135582.682949:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.682951:0:14141:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1783135582.682953:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135582.682958:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.682959:0:14141:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1783135582.682962:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135582.682972:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8e8f062a19c0) 00000020:00000080:3.0:1783135582.682982:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1783135582.682986:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1783135582.682987:0:14141:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1783135582.682990:0:14141:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1783135582.682996:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783135582.683040:0:14141:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8f0aafe000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1783135582.683052:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8e8f062a0000) 00000020:00000080:3.0:1783135582.683139:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1783135582.683213:0:14141:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1783135582.683295:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875d942 00000020:00000080:3.0:1783135582.683687:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1783135582.683694:0:14141:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1783135582.683700:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xf646e0cda875d949 00080000:01000000:3.0:1783135582.683705:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:3.0:1783135582.683709:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875d950 00010000:00010000:3.0:1783135582.824677:0:14141:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1783135582.825154:0:14141:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1783135582.825336:0:14141:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783135582.829556:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8e8f062a3380) 00000020:00000080:3.0:1783135582.829580:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783135582.829681:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783135582.829690:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875d95e 00000020:00000080:1.0:1783135582.830918:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1783135582.840115:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xf646e0cda875d965 00000020:00000080:1.0:1783135582.840879:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1783135582.840891:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135582.840898:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.840906:0:14141:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1783135582.840910:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135582.840917:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.840918:0:14141:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1783135582.840923:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1783135582.840964:0:14141:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1783135582.840978:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135582.840982:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.840983:0:14141:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1783135582.840985:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783135582.840987:0:14141:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1783135582.840989:0:14141:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135582.840991:0:14141:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135582.840992:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783135582.840994:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.840995:0:14141:0:(obd_config.c:1561:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783135582.840997:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135582.841001:0:14141:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783135582.841004:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.841005:0:14141:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1783135582.841007:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135582.841012:0:14141:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.160@tcp to nid 0x20000c0a8c9a0 (192.168.201.160@tcp) 00000020:01000000:1.0:1783135582.841043:0:14141:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783135582.841046:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135582.841186:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8e8f10b60000) 00000020:00000080:1.0:1783135582.841204:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1783135582.841211:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135582.841744:0:14141:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1783135582.841752:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1783135582.841772:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875d973 00010000:00080000:1.0:1783135582.841807:0:14141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8f056f1000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.160@tcp at head 00010000:00010000:1.0:1783135582.842195:0:14141:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1783135582.843751:0:14141:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783135582.843870:0:14141:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783135582.845544:0:14141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135582.845617:0:14141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1783135582.845685:0:14141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1783135582.852550:0:14145:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783135582.852562:0:14145:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1783135582.854029:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135582.854043:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783135582.854092:0:14141:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1783135582.854113:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875d97a 00000100:00080000:1.0:1783135582.854126:0:14141:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135582.854132:0:14141:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8f056f1000 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135582.854169:0:14141:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8e03333b80 x1869752813313920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135582.854198:0:14141:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1783135582.854254:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135582.854258:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.854260:0:14141:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1783135582.854263:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1783135582.854266:0:14141:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1783135582.854267:0:14141:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135582.854269:0:14141:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1783135582.854270:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1783135582.854272:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.854274:0:14141:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1783135582.854276:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1783135582.854281:0:14141:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1783135582.854284:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.854286:0:14141:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1783135582.854288:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1783135582.854292:0:14141:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.160@tcp to nid 0x20000c0a8c9a0 (192.168.201.160@tcp) 00000020:01000000:1.0:1783135582.854316:0:14141:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1783135582.854319:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135582.854345:0:14141:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8e8f10b63380) 00000020:00000080:1.0:1783135582.854356:0:14141:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1783135582.854362:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1783135582.854415:0:14141:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1783135582.854421:0:14141:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1783135582.854426:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xf646e0cda875d988 00010000:00080000:1.0:1783135582.854458:0:14141:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8f122a6800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.160@tcp at head 00010000:00010000:1.0:1783135582.854650:0:14141:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1783135582.854880:0:14141:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1783135582.854902:0:14141:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1783135582.855457:0:14141:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135582.855520:0:14141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1783135582.855586:0:14141:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:3.0:1783135582.856008:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813313920:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1783135582.856076:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752813313920 offset 0 length 520: 4 00000040:00080000:1.0:1783135582.868329:0:14147:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783135582.868339:0:14147:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1783135582.869442:0:14141:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783135582.869456:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1783135582.869491:0:14141:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1783135582.869513:0:14141:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875d98f 00000100:00080000:1.0:1783135582.869524:0:14141:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135582.869530:0:14141:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8f122a6800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135582.869571:0:14141:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8e03331880 x1869752813314048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135582.869603:0:14141:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1783135582.869654:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135582.869659:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.869661:0:14141:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1783135582.869664:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135582.869668:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.869669:0:14141:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783135582.869672:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783135582.869682:0:14141:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1783135582.869685:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135582.869687:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.869689:0:14141:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1783135582.869691:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783135582.869693:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.869695:0:14141:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783135582.869698:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783135582.869731:0:14141:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14141:1869752813314176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135582.869849:0:14141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135582.869884:0:14141:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09f33e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.870004:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813314176 00000100:00100000:0.0:1783135582.870011:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813314176 00000100:00100000:3.0:1783135582.870017:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813314048:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1783135582.870050:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000400:00000100:3.0:1783135582.870055:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752813314048 offset 0 length 520: 4 00000100:00100000:0.0:1783135582.870058:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14141:x1869752813314176:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135582.870304:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14141:x1869752813314176:12345-0@lo:502:llog_process_th.0 Request processed in 246us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.870312:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135582.870319:0:14141:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14141:1869752813314176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783135582.870342:0:14141:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783135582.870346:0:14141:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783135582.870348:0:14141:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783135582.870351:0:14141:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1783135582.870440:0:14105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1783135582.870460:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1783135582.870541:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486800/0xf646e0cda875d918 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d91f expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.870553:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3c486800/0xf646e0cda875d918 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d91f expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135582.870562:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e8f0aafe000 from 1 10000000:01000000:0.0:1783135582.870565:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783135582.870594:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.870608:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.870618:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135582.870631:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135582.870660:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.870688:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04ee0a80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135582.870798:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813314304 00000100:00100000:3.0:1783135582.870804:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813314304 00000100:00100000:3.0:1783135582.870863:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783135582.870870:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+9:14105:x1869752813314304:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135582.870880:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135582.870895:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875d996 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.870916:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875d996 expref: 10 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.870937:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d996 expref: 10 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.870945:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c487200, rc 0) 00000100:00100000:3.0:1783135582.870979:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+10:14105:x1869752813314304:12345-0@lo:101:mount.lustre.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135582.870984:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135582.872603:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135582.872629:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.872641:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135582.873354:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314432:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1783135582.873425:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.873481:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04ee0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135582.873811:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813314432 00000100:00100000:1.0:1783135582.873847:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813314432 00000100:00100000:1.0:1783135582.873900:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135582.873909:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+10:14105:x1869752813314432:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1783135582.873930:0:14118:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783135582.873937:0:14118:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783135582.874019:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+10:14105:x1869752813314432:12345-0@lo:256:mount.lustre.0 Request processed in 110us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.874027:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135582.875064:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314432:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1783135582.875654:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135582.876753:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.876777:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135582.876855:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f0aafe000 from 1 10000000:01000000:0.0:1783135582.876858:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135582.876895:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.876903:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.876913:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135582.876938:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314560:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135582.877076:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.877123:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04ee0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135582.877558:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813314560 00000100:00100000:1.0:1783135582.877566:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813314560 00000100:00100000:1.0:1783135582.877621:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135582.877630:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+10:14105:x1869752813314560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135582.877659:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135582.877673:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875d9a4 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.877696:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.877706:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.877714:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d200, rc 0) 00000100:00100000:1.0:1783135582.877775:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14105:x1869752813314560:12345-0@lo:101:mount.lustre.0 Request processed in 146us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.877781:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783135582.877929:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135582.877945:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.877954:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135582.878011:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135582.878040:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.878074:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135582.879113:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813314688 00000100:00100000:1.0:1783135582.879122:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813314688 00000100:00100000:1.0:1783135582.879169:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135582.879178:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14105:x1869752813314688:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135582.879632:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14105:x1869752813314688:12345-0@lo:501:mount.lustre.0 Request processed in 454us (1590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.879641:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135582.879894:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314688:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135582.879947:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135582.879993:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.880029:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135582.880053:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813314816 00000100:00100000:2.0:1783135582.880058:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813314816 00000100:00100000:2.0:1783135582.880091:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783135582.880098:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14105:x1869752813314816:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135582.880255:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14105:x1869752813314816:12345-0@lo:503:mount.lustre.0 Request processed in 157us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135582.880302:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813314816:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135582.880736:0:14149:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14149:1869752813314944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135582.880785:0:14149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.880832:0:14149:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.881000:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813314944 00000100:00100000:0.0:1783135582.881005:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813314944 00000100:00100000:2.0:1783135582.892136:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135582.893167:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783135582.893186:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14149:x1869752813314944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135582.893622:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14149:x1869752813314944:12345-0@lo:502:llog_process_th.0 Request processed in 443us (12834us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.893630:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783135582.893740:0:14149:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14149:1869752813314944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135582.893789:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135582.893800:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.893802:0:14149:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783135582.893808:0:14149:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8f0aafe000 00000020:00000080:3.0:1783135582.893811:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135582.893841:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135582.893844:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.893845:0:14149:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783135582.893848:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135582.893850:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.893851:0:14149:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783135582.893854:0:14149:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8f0aafe000 00000020:00000080:3.0:1783135582.893856:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783135582.893917:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135582.893920:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.893921:0:14149:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783135582.893923:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135582.893926:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.893927:0:14149:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783135582.893930:0:14149:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8f0aafe000 00000020:00000080:3.0:1783135582.893932:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783135582.894743:0:14149:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14149:1869752813315072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135582.894809:0:14149:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.904066:0:14149:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135582.904407:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813315072 00000100:00100000:1.0:1783135582.904418:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813315072 00000100:00100000:1.0:1783135582.904574:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135582.904584:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14149:x1869752813315072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783135582.904888:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14149:x1869752813315072:12345-0@lo:502:llog_process_th.0 Request processed in 305us (10078us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.904905:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783135582.905602:0:14149:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14149:1869752813315072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783135582.905646:0:14149:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135582.905655:0:14149:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135582.905657:0:14149:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783135582.905662:0:14149:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1783135582.906970:0:14105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783135582.906998:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135582.907022:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.907034:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135582.907108:0:14105:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783135582.907111:0:14105:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8f0aafe000 10000000:01000000:0.0:1783135582.907114:0:14105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8f0aafe000 10000000:01000000:0.0:1783135582.907118:0:14105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783135582.907123:0:14105:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f0aafe000 from 1 10000000:01000000:0.0:1783135582.907126:0:14105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783135582.907156:0:14105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042800/0xf646e0cda875d9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.907164:0:14105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042800/0xf646e0cda875d9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.907173:0:14105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042800/0xf646e0cda875d9b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135582.907195:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813315200:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135582.915552:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.915605:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05923c00 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.915717:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813315200 00000100:00100000:0.0:1783135582.915725:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813315200 00000100:00100000:0.0:1783135582.915795:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135582.915804:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14105:x1869752813315200:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135582.915839:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135582.915857:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3d042a00/0xf646e0cda875d9b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875d9b2 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.915885:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3d042a00/0xf646e0cda875d9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875d9b2 expref: 12 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.915910:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3d042a00/0xf646e0cda875d9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d9b2 expref: 12 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.915920:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042a00, rc 0) 00000100:00100000:0.0:1783135582.915963:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14105:x1869752813315200:12345-0@lo:101:mount.lustre.0 Request processed in 159us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.915969:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783135582.916031:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813315200:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135582.916053:0:14105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042800/0xf646e0cda875d9b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9b9 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135582.917010:0:14105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042800/0xf646e0cda875d9b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875d9b9 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135582.917298:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813315328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135582.917434:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.917476:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08911a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135582.919191:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813315328 00000100:00100000:1.0:1783135582.919203:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813315328 00000100:00100000:1.0:1783135582.919263:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135582.919274:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14105:x1869752813315328:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135582.919583:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14105:x1869752813315328:12345-0@lo:501:mount.lustre.0 Request processed in 310us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.919591:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783135582.919939:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813315328:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135582.919992:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813315456:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135582.920039:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.920094:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08911a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.920112:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813315456 00000100:00100000:0.0:1783135582.920116:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813315456 00000100:00100000:0.0:1783135582.920146:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135582.920153:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14105:x1869752813315456:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135582.920495:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14105:x1869752813315456:12345-0@lo:503:mount.lustre.0 Request processed in 341us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.920502:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783135582.920544:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3de300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813315456:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135582.925360:0:14155:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14155:1869752813315584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135582.925449:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.925483:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813315584 00000100:00100000:3.0:1783135582.925484:0:14155:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1783135582.925490:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813315584 00000100:00100000:0.0:1783135582.925531:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783135582.925539:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14155:x1869752813315584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783135582.925838:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14155:x1869752813315584:12345-0@lo:502:llog_process_th.0 Request processed in 277us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135582.925845:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783135582.926169:0:14155:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14155:1869752813315584:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1783135582.926233:0:14155:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1783135582.926248:0:14155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8e8f062a4d40) 00000020:00000080:3.0:1783135582.926268:0:14155:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1783135582.926427:0:14155:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8f0aafe000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783135582.926431:0:14155:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8f0aafe000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1783135582.926434:0:14155:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8f0aafe000 4 00010000:00080000:3.0:1783135582.926458:0:14155:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8e0182d800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.160@tcp at head 00010000:00010000:3.0:1783135582.934266:0:14155:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1783135582.934375:0:14155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1783135582.934414:0:14155:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783135582.934427:0:14155:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xf646e0cda875d9c7 00000100:00080000:3.0:1783135582.934438:0:14155:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783135582.934444:0:14155:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e8e0182d800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:3.0:1783135582.934479:0:14155:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8e026e6680 x1869752813315712/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783135582.934511:0:14155:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783135582.936205:0:14155:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14155:1869752813315840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135582.936291:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.936334:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813315840 00000100:00100000:3.0:1783135582.936340:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813315840 00000100:00100000:3.0:1783135582.936382:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135582.936391:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14155:x1869752813315840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783135582.936627:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14155:x1869752813315840:12345-0@lo:502:llog_process_th.0 Request processed in 235us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135582.936640:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783135582.936687:0:14155:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135582.936707:0:14155:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14155:1869752813315840:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1783135582.936732:0:14155:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783135582.937436:0:14105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783135582.937467:0:14105:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135582.937490:0:14105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042800/0xf646e0cda875d9b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9b9 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.937513:0:14105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042800/0xf646e0cda875d9b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9b9 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783135582.937564:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783135582.937566:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783135582.937567:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135582.937569:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135582.937570:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135582.937571:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135582.937573:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135582.937574:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783135582.937576:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135582.937577:0:14105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135582.937582:0:14105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783135582.937584:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135582.937586:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783135582.937587:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135582.937588:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135582.937589:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135582.937590:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135582.937591:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783135582.937592:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783135582.937593:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135582.937594:0:14105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135582.937616:0:14105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783135582.937628:0:14105:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813315968:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135582.937669:0:14105:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135582.937692:0:14105:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f395e4600 going to sleep for 11 seconds 00000100:00100000:3.0:1783135582.937800:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813315968 00000100:00100000:3.0:1783135582.937806:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813315968 00000100:00100000:3.0:1783135582.937860:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783135582.937868:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14105:x1869752813315968:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135582.938094:0:14116:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783135582.938109:0:14116:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1783135582.938878:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813315712:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783135582.938933:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135582.940984:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813315712 00000100:00100000:0.0:1783135582.940997:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813315712 00000100:00100000:0.0:1783135582.941041:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135582.941049:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1869752813315712:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783135582.941148:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1869752813315712:12345-0@lo:38:llog_process_th.0 Request processed in 98us (2212us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783135582.941155:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135582.941196:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135582.941204:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8e0182d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783135582.941208:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783135582.941211:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813315712:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1783135582.985547:0:14116:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1783135582.985568:0:14116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1783135582.985723:0:14139:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135582.985729:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783135582.985753:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.985783:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d996 expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.985793:0:14139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.985873:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875d996 expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135582.985886:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875d996 expref: 12 pid: 14117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135582.985902:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869752813316096:0@lo:104: 00000100:00100000:2.0:1783135582.985967:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135582.986007:0:14139:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f26472cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135582.986918:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813316096 00000100:00100000:1.0:1783135582.986928:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813316096 00000100:00100000:1.0:1783135582.986982:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135582.986992:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:14139:x1869752813316096:12345-0@lo:104: 00010000:00010000:1.0:1783135582.987006:0:14106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987089:0:14106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135582.987095:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:14139:x1869752813316096:12345-0@lo:104: Request processed in 105us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.987102:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1783135582.987124:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135582.987129:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987136:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042000 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135582.987140:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987165:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135582.987172:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135582.987178:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135582.987208:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987214:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135582.987234:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987241:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042000/0xf646e0cda875d996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d99d expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987258:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135582.987260:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135582.987261:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135582.987296:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3312:1869752813316224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135582.987328:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135582.987393:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813316224 00000100:00100000:1.0:1783135582.987398:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813316224 00010000:00010000:1.0:1783135582.987414:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875d996 expref: 13 pid: 14117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135582.987434:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135582.987441:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+13:3312:x1869752813316224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135582.987458:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135582.987464:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875d996 expref: 13 pid: 14117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987474:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875d996 expref: 13 pid: 14117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987490:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987498:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783135582.987511:0:14108:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001783181s 00010000:00010000:1.0:1783135582.987515:0:14108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987522:0:14108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987528:0:14108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987534:0:14108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987539:0:14108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135582.987543:0:14108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987550:0:14108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987565:0:14108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135582.987574:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135582.987602:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+13:3312:x1869752813316224:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.987609:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135582.987645:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3312:1869752813316224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135582.989327:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487200/0xf646e0cda875d99d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875d996 expref: 12 pid: 14117 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135582.989347:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869752813316096:0@lo:104: 00010000:00010000:3.0:1783135582.989371:0:14139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.989382:0:14139:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.989387:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135582.989393:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f02c38400/0xf646e0cda875d9ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135582.995496:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14105:x1869752813315968:12345-0@lo:253:mount.lustre.0 Request processed in 57616us (57813us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135582.995511:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135582.995613:0:14105:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14105:1869752813315968:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135582.995630:0:14105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1783135582.995633:0:14105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135582.995635:0:14105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1783135582.995637:0:14105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135582.995638:0:14105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135582.995639:0:14105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135582.995640:0:14105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135582.995642:0:14105:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1783135582.995643:0:14105:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1783135582.995645:0:14105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135582.995646:0:14105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135582.995661:0:14105:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783135583.001571:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135583.001749:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135583.002232:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135583.002400:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135583.002671:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135583.003028:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135583.004025:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135583.004198:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135583.004439:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135583.004651:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1783135583.004980:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1783135583.005146:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1783135583.034050:0:14105:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1783135583.034442:0:14105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783135583.034763:0:14164:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1783135583.034861:0:14164:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135583.038719:0:14164:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1783135583.038847:0:14164:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1783135583.038851:0:14164:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:0.0:1783135583.040172:0:14163:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1783135583.040185:0:14163:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1783135583.040461:0:14105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1783135583.040599:0:14105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1783135583.042306:0:14105:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1783135583.042327:0:14105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1783135583.042597:0:14105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135583.044237:0:14105:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1783135583.044766:0:14105:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1783135583.044796:0:14105:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1783135583.046424:0:14105:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1783135583.053848:0:14105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1783135583.092527:0:14105:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783135583.092579:0:14105:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9c27415f7988 00100000:10000000:1.0:1783135583.092587:0:14105:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783135583.093615:0:14105:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783135583.093632:0:14105:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.160@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783135583.093649:0:14105:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783135583.093671:0:14105:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1783135583.419676:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783135583.802015:0:14120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783135583.802024:0:14120:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e8f0aafe000 from 6 10000000:01000000:1.0:1783135583.802029:0:14120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783135583.802078:0:14120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135583.802091:0:14120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135583.802103:0:14120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135583.802146:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813316352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135583.802221:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135583.802281:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9af00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135583.802409:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813316352 00000100:00100000:2.0:1783135583.802417:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813316352 00000100:00100000:2.0:1783135583.802483:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783135583.802492:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14120:x1869752813316352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135583.802506:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135583.802520:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875d9d5 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.802545:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.802555:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.802563:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38800, rc 0) 00000100:00100000:2.0:1783135583.802604:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14120:x1869752813316352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135583.802611:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783135583.804003:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813316352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135583.804029:0:14120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135583.804042:0:14120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135583.804119:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813316480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783135583.804202:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135583.804236:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9af00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135583.804252:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813316480 00000100:00100000:1.0:1783135583.804256:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813316480 00000100:00100000:1.0:1783135583.804293:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783135583.804301:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14120:x1869752813316480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135583.804320:0:14116:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135583.804334:0:14116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135583.804337:0:14116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1783135583.804453:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14120:x1869752813316480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 151us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135583.804461:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783135583.806052:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813316480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1783135583.806127:0:14120:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783135583.806138:0:14120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135583.806160:0:14120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135583.932395:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783135584.445240:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135584.954443:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783135585.468536:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135586.492979:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135587.514961:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783135587.971915:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135587.971923:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135587.971926:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135587.971929:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1783135587.971932:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1783135587.971935:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1783135587.971939:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e8e0182d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135587.971954:0:37:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8e8e0182d800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135587.971979:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8e03331180 x1869752813316736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135587.972043:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3313:1869752813316608:0@lo:400:kworker.0 00000100:00100000:1.0:1783135587.972116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135587.972360:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813316736:0@lo:38:kworker.0 00000100:00100000:0.0:1783135587.972423:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135587.973318:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813316608 00000100:00100000:1.0:1783135587.973329:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813316608 00000100:00100000:1.0:1783135587.973387:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135587.973399:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:3313:x1869752813316608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135587.973468:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:3313:x1869752813316608:12345-0@lo:400:kworker.0 Request processed in 71us (1350us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135587.973476:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1783135587.975237:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813316736 00000100:00100000:0.0:1783135587.975251:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813316736 00000100:00100000:0.0:1783135587.975293:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135587.975301:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1869752813316736:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1783135587.975330:0:14125:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:0.0:1783135587.975368:0:14125:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xf646e0cda875d9e3 00000004:00100000:0.0:1783135587.975385:0:14125:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:1.0:1783135587.976607:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3313:1869752813316608:0@lo:400:kworker.0 00000100:00080000:0.0:1783135587.978018:0:14125:0:(import.c:65:import_set_state_nolock()) ffff8e8f3ccb7800 : changing import state from RECOVER to FULL 00010000:00080000:1.0:1783135587.979874:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8e03331180 x1869752813316736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135587.979898:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783135587.979908:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783135587.979920:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783135587.979923:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8e0182d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783135587.979930:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869752813316736:0@lo:38:kworker.0 00000100:00100000:0.0:1783135587.980246:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869752813316736:12345-0@lo:38:kworker.0 Request processed in 2828us (5707us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135587.980258:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783135588.539064:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135588.642582:0:14407:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783135589.569847:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135590.586096:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135591.610011:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135592.057949:0:3310:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135582/real 1783135582] req@ffff8e8e03331880 x1869752813314048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135592.058011:0:3310:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8e03331880 x1869752813314048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135592.058057:0:3310:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135582/real 1783135582] req@ffff8e8e03333b80 x1869752813313920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135592 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135592.058071:0:3310:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8e03333b80 x1869752813313920/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135592 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783135592.058100:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135592.058121:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783135592.058125:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813314048:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783135592.058131:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f056f1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783135592.058136:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783135592.058139:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813313920:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1783135592.058586:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135592.058591:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1783135592.058595:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e8f056f1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135592.058617:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:0.0:1783135592.058622:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135592.058628:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8f056f1000 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:0.0:1783135592.058652:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f3c3ded80 x1869752813316992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783135592.058665:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135592.058681:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1783135592.058683:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783135592.058686:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 482 00000100:00080000:0.0:1783135592.058689:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783135592.058692:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8f122a6800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:0.0:1783135592.058705:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f3c3dd500 x1869752813317120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135592.058746:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3314:1869752813316864:0@lo:400:kworker.0 00000100:00100000:0.0:1783135592.058778:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813316992:0@lo:8:kworker.0 00000100:00100000:1.0:1783135592.058853:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000400:00000100:0.0:1783135592.058862:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752813316992 offset 0 length 520: 4 00000100:00100000:2.0:1783135592.059024:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813317248:0@lo:400:kworker.0 00000100:00100000:0.0:1783135592.064323:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813317120:0@lo:8:kworker.0 00000400:00000100:0.0:1783135592.064383:0:3310:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869752813317120 offset 0 length 520: 4 00000100:00100000:0.0:1783135592.064455:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813316864 00000100:00100000:0.0:1783135592.064462:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813316864 00000100:00100000:0.0:1783135592.064509:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783135592.064517:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:3314:x1869752813316864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135592.064579:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:3314:x1869752813316864:12345-0@lo:400:kworker.0 Request processed in 62us (5726us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135592.064586:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135592.065110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135592.065467:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813317248 00000100:00100000:0.0:1783135592.065475:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813317248 00000100:00100000:0.0:1783135592.065557:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135592.065567:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813317248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135592.065638:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c049f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813317248:12345-0@lo:400:kworker.0 Request processed in 73us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135592.065645:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135592.067233:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3314:1869752813316864:0@lo:400:kworker.0 00010000:00080000:1.0:1783135592.068483:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8f3c3dc380 x1869752813317248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783135592.068499:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813317248:0@lo:400:kworker.0 00000020:00000080:2.0:1783135592.208266:0:14557:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe8ecc8e30 20000000:00000080:2.0:1783135592.208292:0:14557:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8f3f06fc00 uarg=0000000000000000 20000000:01000000:2.0:1783135592.208461:0:14557:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1783135592.208470:0:14557:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1783135592.208475:0:14557:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1783135592.220917:0:14558:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1783135592.221406:0:14557:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783135592.240169:0:14557:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783135592.240200:0:14557:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.240220:0:14557:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.240230:0:14557:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.240281:0:14557:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 11 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135592.240298:0:14557:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 11 pid: 14116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135592.240381:0:14557:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14557:1869752813317376:0@lo:104: 00000100:00100000:3.0:1783135592.240459:0:14557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135592.240554:0:14557:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09356480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135592.246686:0:14107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813317376 00000100:00100000:0.0:1783135592.246704:0:14107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813317376 00000100:00100000:0.0:1783135592.246808:0:14107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135592.248147:0:14107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:14557:x1869752813317376:12345-0@lo:104: 00010000:00010000:0.0:1783135592.248167:0:14107:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135592.249544:0:14107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783135592.249563:0:14107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:14557:x1869752813317376:12345-0@lo:104: Request processed in 1429us (9098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135592.249577:0:14107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1783135592.251186:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135592.251200:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251212:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042200 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135592.251217:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251227:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135592.251235:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135592.251240:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783135592.251296:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251302:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135592.251328:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251335:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042200/0xf646e0cda875d9a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9ab expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251374:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135592.251376:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135592.251377:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135592.251396:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3312:1869752813317504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783135592.251472:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135592.251532:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813317504 00000100:00100000:1.0:1783135592.251540:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813317504 00010000:00010000:1.0:1783135592.251621:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 12 pid: 14116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135592.251659:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135592.251669:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:3312:x1869752813317504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783135592.251683:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783135592.251687:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 12 pid: 14116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251698:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 12 pid: 14116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251717:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251726:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251741:0:14108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251748:0:14108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251760:0:14108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251766:0:14108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251772:0:14108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135592.251775:0:14108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251782:0:14108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251791:0:14108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.251799:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783135592.251865:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:3312:x1869752813317504:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135592.251873:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135592.251925:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3312:1869752813317504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783135592.258360:0:14557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875d9ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875d9a4 expref: 11 pid: 14116 timeout: 591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135592.258383:0:14557:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14557:1869752813317376:0@lo:104: 00010000:00010000:3.0:1783135592.258426:0:14557:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.260214:0:14557:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.260232:0:14557:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135592.260240:0:14557:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c486400/0xf646e0cda875d9ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14557 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135592.634159:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135593.658026:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783135594.115841:0:14120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135594.115850:0:14120:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f0aafe000 from 10 10000000:01000000:1.0:1783135594.115865:0:14120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135594.115926:0:14120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.115959:0:14120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.115972:0:14120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.116000:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813317632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135594.116074:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135594.116138:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135594.117324:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813317632 00000100:00100000:0.0:1783135594.117335:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813317632 00000100:00100000:0.0:1783135594.117429:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783135594.117440:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+11:14120:x1869752813317632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135594.117457:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135594.117479:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875d9f1 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.117507:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 12 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.117518:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 12 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135594.117529:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043a00, rc 0) 00000100:00100000:0.0:1783135594.117621:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14120:x1869752813317632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135594.117644:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783135594.122083:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813317632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135594.122116:0:14120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.122130:0:14120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135594.122225:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813317760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135594.122286:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135594.122336:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135594.122956:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813317760 00000100:00100000:0.0:1783135594.122964:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813317760 00000100:00100000:0.0:1783135594.123015:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783135594.123037:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14120:x1869752813317760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135594.123377:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14120:x1869752813317760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 351us (1090us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135594.123385:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783135594.124046:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813317760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135594.124098:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813317888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135594.124151:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135594.124187:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135594.124300:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813317888 00000100:00100000:0.0:1783135594.124306:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813317888 00000100:00100000:0.0:1783135594.124337:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783135594.124344:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14120:x1869752813317888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135594.130864:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14120:x1869752813317888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6493us (6686us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135594.130884:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783135594.136931:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813317888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783135594.138484:0:14619:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783135594.138696:0:14120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783135594.138717:0:14120:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135594.138751:0:14120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135594.138763:0:14120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135594.171445:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783135594.688641:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135595.714243:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135596.732688:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783135596.773142:0:14758:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:3.0:1783135596.773146:0:14758:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783135596.773314:0:14758:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8e0182e000 00000020:01000004:3.0:1783135596.773331:0:14758:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783135596.773344:0:14758:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783135596.773359:0:14758:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8e8f09d08000) 00000020:00000080:3.0:1783135596.773375:0:14758:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783135596.803563:0:14758:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783135596.804455:0:14758:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783135596.805933:0:14758:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783135596.806172:0:14758:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783135596.806562:0:14758:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783135596.807156:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 521: rc = 0 00100000:10000000:2.0:1783135596.807252:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 521: rc = 0 00100000:10000000:2.0:1783135596.807439:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 521: rc = 0 00100000:10000000:2.0:1783135596.808272:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 642: rc = 0 00100000:10000000:2.0:1783135596.808719:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:2.0:1783135596.809245:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 642: rc = 0 00100000:10000000:2.0:1783135596.809716:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:2.0:1783135596.810043:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 642: rc = 0 00100000:10000000:2.0:1783135596.810269:0:14758:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 642: rc = 0 00000020:00000080:2.0:1783135596.811081:0:14758:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783135596.811092:0:14758:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783135596.811102:0:14758:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf646e0cda875da06 00000020:01000004:2.0:1783135596.811110:0:14758:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783135596.811132:0:14758:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783135596.811135:0:14758:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783135596.811141:0:14758:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783135596.811146:0:14758:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783135596.811157:0:14758:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8e8f3fc319c0) 00000020:00000080:2.0:1783135596.811166:0:14758:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1783135596.812600:0:14758:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135596.817931:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1783135596.817940:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1783135596.818533:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1783135596.818540:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783135596.818967:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783135596.818974:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783135596.822166:0:14758:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135596.822344:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135596.822350:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783135596.829024:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783135596.829039:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783135596.847244:0:14758:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135596.847567:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783135596.847574:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1783135596.849071:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783135596.849081:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783135596.850003:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783135596.850013:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783135596.851922:0:14758:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783135596.852150:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783135596.852156:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1783135596.853589:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135596.853598:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1783135596.905119:0:14758:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783135596.905411:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1783135596.905419:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1783135596.907267:0:14758:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1783135596.907281:0:14758:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1783135596.907755:0:14758:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1783135596.907780:0:14758:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1783135596.907786:0:14758:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1783135596.918148:0:14758:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.160@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783135596.918194:0:14758:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.160@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1783135596.918198:0:14758:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783135596.918200:0:14758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135596.918201:0:14758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135596.918203:0:14758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135596.918204:0:14758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135596.918206:0:14758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135596.918207:0:14758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135596.918209:0:14758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135596.918210:0:14758:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135596.918214:0:14758:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1783135596.918216:0:14758:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783135596.918217:0:14758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135596.918219:0:14758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135596.918220:0:14758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135596.918221:0:14758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135596.918222:0:14758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135596.918223:0:14758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135596.918224:0:14758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135596.918225:0:14758:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783135596.918262:0:14758:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1783135596.918283:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1783135596.918469:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.918599:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0300 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.918709:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813318016 00000100:00100000:0.0:1783135596.918717:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813318016 00000100:00100000:0.0:1783135596.918798:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783135596.918807:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14758:x1869752813318016:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135596.918866:0:14118:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1783135596.918870:0:14118:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1783135596.918874:0:14118:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1783135596.926070:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14758:x1869752813318016:12345-0@lo:253:mount.lustre.0 Request processed in 7254us (7590us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.926084:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783135596.926194:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318016:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1783135596.926210:0:14758:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1783135596.926214:0:14758:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783135596.926216:0:14758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1783135596.926217:0:14758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783135596.926218:0:14758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783135596.926220:0:14758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783135596.926221:0:14758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783135596.926223:0:14758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783135596.926224:0:14758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783135596.926225:0:14758:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1783135596.926316:0:14758:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8e0182e000 from lustre-OST0000 10000000:01000000:1.0:1783135596.926346:0:14758:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1783135596.926349:0:14758:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783135596.926357:0:14758:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8f05393380 local copy 00010000:00010000:1.0:1783135596.926369:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135596.926702:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318144:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135596.926746:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.926786:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0780 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.926916:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813318144 00000100:00100000:0.0:1783135596.926923:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813318144 00000100:00100000:0.0:1783135596.927044:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783135596.927053:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14758:x1869752813318144:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135596.927231:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14758:x1869752813318144:12345-0@lo:501:mount.lustre.0 Request processed in 178us (484us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135596.927314:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783135596.927386:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318144:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1783135596.927400:0:14758:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1783135596.927560:0:14758:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1783135596.927568:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.927579:0:14758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135596.927624:0:14758:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8e0182e000 10000000:01000000:1.0:1783135596.927629:0:14758:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1783135596.927635:0:14758:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8e8f05393380 10000000:01000000:1.0:1783135596.927637:0:14758:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1783135596.927641:0:14758:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff8e8f05393380 from 1 10000000:01000000:1.0:1783135596.927643:0:14758:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1783135596.927667:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c200/0xf646e0cda875da14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.927676:0:14758:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c200/0xf646e0cda875da14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.927686:0:14758:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c200/0xf646e0cda875da14 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135596.927700:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135596.927727:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.927977:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135596.928087:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813318272 00000100:00100000:2.0:1783135596.928093:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813318272 00000100:00100000:2.0:1783135596.928119:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783135596.928126:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+12:14758:x1869752813318272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135596.928136:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.928151:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f02c39c00/0xf646e0cda875da1b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875da14 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.928172:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f02c39c00/0xf646e0cda875da1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875da14 expref: 13 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.928190:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f02c39c00/0xf646e0cda875da1b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875da14 expref: 13 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.928199:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c39c00, rc 0) 00000100:00100000:2.0:1783135596.928249:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+13:14758:x1869752813318272:12345-0@lo:101:mount.lustre.0 Request processed in 123us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.928256:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783135596.928398:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318272:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135596.928412:0:14758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c200/0xf646e0cda875da14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da1b expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.928420:0:14758:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c200/0xf646e0cda875da14 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875da1b expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135596.928437:0:14758:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1783135596.928451:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c200/0xf646e0cda875da14 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da1b expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.928468:0:14758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c200/0xf646e0cda875da14 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da1b expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135596.928475:0:14758:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1783135596.928478:0:14758:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783135596.928482:0:14758:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1783135596.928484:0:14758:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783135596.928500:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c000/0xf646e0cda875da22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.928507:0:14758:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c000/0xf646e0cda875da22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.928524:0:14758:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c000/0xf646e0cda875da22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135596.928537:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318400:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783135596.928564:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.928576:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0780 going to sleep for 11 seconds 00000100:00100000:2.0:1783135596.928645:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813318400 00000100:00100000:2.0:1783135596.928649:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813318400 00000100:00100000:2.0:1783135596.928668:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783135596.928673:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+13:14758:x1869752813318400:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135596.928680:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.928687:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f02c38600/0xf646e0cda875da29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875da22 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.928700:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f02c38600/0xf646e0cda875da29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875da22 expref: 14 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.928708:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f02c38600/0xf646e0cda875da29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875da22 expref: 14 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.928714:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38600, rc 0) 00000100:00100000:2.0:1783135596.928747:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318400:12345-0@lo:101:mount.lustre.0 Request processed in 74us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.928753:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783135596.928933:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318400:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135596.928943:0:14758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c000/0xf646e0cda875da22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da29 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.928951:0:14758:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c000/0xf646e0cda875da22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875da29 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135596.929575:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783135596.930555:0:14758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783135596.931290:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783135596.931337:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783135596.931368:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783135596.931421:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783135596.931463:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783135596.931499:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783135596.931578:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783135596.931587:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783135596.931735:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135596.931799:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.931984:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0000 going to sleep for 11 seconds 00000100:00100000:3.0:1783135596.932052:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813318528 00000100:00100000:3.0:1783135596.932067:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813318528 00000100:00100000:3.0:1783135596.932124:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783135596.932133:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135596.932475:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318528:12345-0@lo:501:mount.lustre.0 Request processed in 341us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.932482:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1783135596.932765:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318528:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135596.932809:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318656:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135596.932955:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.932986:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0000 going to sleep for 11 seconds 00000100:00100000:3.0:1783135596.933039:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813318656 00000100:00100000:3.0:1783135596.933044:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813318656 00000100:00100000:3.0:1783135596.933069:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783135596.933075:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318656:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135596.933448:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318656:12345-0@lo:503:mount.lustre.0 Request processed in 371us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.933455:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1783135596.933542:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318656:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135596.934757:0:14758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135596.935019:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135596.935081:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.935170:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0000 going to sleep for 11 seconds 00000100:00100000:0.0:1783135596.935337:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813318784 00000100:00100000:0.0:1783135596.935344:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813318784 00000100:00100000:0.0:1783135596.935422:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783135596.935432:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135596.935701:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318784:12345-0@lo:502:mount.lustre.0 Request processed in 270us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135596.935709:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783135596.935788:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135596.936063:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1783135596.936112:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1783135596.936144:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1783135596.936201:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1783135596.936253:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1783135596.936300:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1783135596.936356:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1783135596.936390:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1783135596.936420:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1783135596.936469:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1783135596.936504:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1783135596.936565:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1783135596.936596:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135596.936641:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135596.937090:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f111c0000 going to sleep for 11 seconds 00000100:00100000:3.0:1783135596.937179:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813318912 00000100:00100000:3.0:1783135596.937185:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813318912 00000100:00100000:3.0:1783135596.937218:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783135596.937226:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135596.937444:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813318912:12345-0@lo:502:mount.lustre.0 Request processed in 218us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.937452:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783135596.937669:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813318912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135596.937743:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1783135596.937756:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1783135596.938774:0:14772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783135596.938783:0:14772:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1783135596.938796:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135596.938798:0:14772:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783135596.938804:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783135596.939082:0:14772:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8e8f10b619c0) 00000020:00000080:1.0:1783135596.939103:0:14772:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1783135596.939114:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783135596.939176:0:14772:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8e0182e000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1783135596.939183:0:14772:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1783135596.939190:0:14772:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xf646e0cda875da37 00010000:00010000:1.0:1783135596.944335:0:14772:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1783135596.946550:0:14772:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:1.0:1783135596.953063:0:14772:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783135596.956108:0:14772:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1783135596.956121:0:14772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135596.956129:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135596.956131:0:14772:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1783135596.956135:0:14772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783135596.956138:0:14772:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1783135596.956139:0:14772:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135596.956141:0:14772:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783135596.956150:0:14772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783135596.956153:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135596.956154:0:14772:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783135596.956157:0:14772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135596.956160:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135596.956162:0:14772:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783135596.956165:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783135596.956167:0:14772:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783135596.956169:0:14772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135596.956171:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135596.956172:0:14772:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783135596.956175:0:14772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135596.956177:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135596.956178:0:14772:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783135596.956181:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783135596.956371:0:14772:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135596.956376:0:14772:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135596.956378:0:14772:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783135596.956381:0:14772:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1783135596.959158:0:14758:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1783135596.959198:0:14758:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1783135596.959326:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c000/0xf646e0cda875da22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da29 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.959339:0:14758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f0121c000/0xf646e0cda875da22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da29 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135596.959348:0:14758:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8e0182e000 from 1 10000000:01000000:0.0:1783135596.959351:0:14758:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135596.959388:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.959397:0:14758:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.959408:0:14758:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135596.959433:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783135596.959500:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135596.959562:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09f30900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.959926:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813319040 00000100:00100000:1.0:1783135596.959935:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813319040 00000100:00100000:1.0:1783135596.959974:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1783135596.959983:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+14:14758:x1869752813319040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135596.959997:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135596.960009:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875da3e expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.960034:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875da3e expref: 15 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.960054:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875da3e expref: 15 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135596.960064:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c600, rc 0) 00000100:00100000:1.0:1783135596.960108:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319040:12345-0@lo:101:mount.lustre.0 Request processed in 125us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.960115:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783135596.960209:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135596.960223:0:14758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135596.960232:0:14758:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135596.961166:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1783135596.964901:0:14758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783135596.965227:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1783135596.965479:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1783135596.965556:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1783135596.965564:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1783135596.965672:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135596.965738:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135596.965793:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09f30900 going to sleep for 11 seconds 00000100:00100000:3.0:1783135596.966472:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813319168 00000100:00100000:3.0:1783135596.966480:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813319168 00000100:00100000:3.0:1783135596.966572:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783135596.966583:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319168:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135596.966982:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319168:12345-0@lo:501:mount.lustre.0 Request processed in 400us (1242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.966990:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783135596.967076:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319168:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135596.967112:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319296:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135596.967157:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135596.967506:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09f30900 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.967591:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813319296 00000100:00100000:1.0:1783135596.967596:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813319296 00000100:00100000:1.0:1783135596.967633:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783135596.967641:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135596.967801:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319296:12345-0@lo:503:mount.lustre.0 Request processed in 159us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.967809:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783135596.967964:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319296:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783135596.968531:0:14758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783135596.968599:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319424:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135596.968716:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135596.968748:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f088cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.968888:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813319424 00000100:00100000:1.0:1783135596.968894:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813319424 00000100:00100000:1.0:1783135596.968922:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783135596.968929:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135596.969089:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319424:12345-0@lo:502:mount.lustre.0 Request processed in 158us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.969097:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783135596.969285:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319424:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135596.969551:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783135596.969601:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783135596.969669:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783135596.969710:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783135596.969746:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783135596.969799:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783135596.971900:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783135596.971951:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1783135596.972006:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319552:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135596.972092:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135596.972153:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f088cecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135596.972314:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813319552 00000100:00100000:1.0:1783135596.972322:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813319552 00000100:00100000:1.0:1783135596.972362:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783135596.972372:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319552:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135596.972580:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319552:12345-0@lo:502:mount.lustre.0 Request processed in 209us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135596.972595:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783135596.973540:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319552:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783135596.973708:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783135596.973722:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783135596.975146:0:14776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135596.975157:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135596.975160:0:14776:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783135596.975167:0:14776:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8e0182e000 00000020:00000080:0.0:1783135596.975169:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135596.975176:0:14776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135596.975179:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135596.975180:0:14776:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783135596.975183:0:14776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135596.975185:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135596.975186:0:14776:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783135596.975190:0:14776:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8e0182e000 00000020:00000080:0.0:1783135596.975192:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135596.975354:0:14776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135596.975359:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135596.975361:0:14776:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783135596.975364:0:14776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783135596.975366:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135596.975368:0:14776:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783135596.975371:0:14776:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8e0182e000 00000020:00000080:0.0:1783135596.975373:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783135596.975702:0:14776:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783135596.975707:0:14776:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783135596.975709:0:14776:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783135596.975728:0:14776:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1783135596.977768:0:14758:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1783135596.977970:0:14758:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783135596.977993:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.978003:0:14758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135596.978061:0:14758:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783135596.978063:0:14758:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8e0182e000 10000000:01000000:2.0:1783135596.978066:0:14758:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8e0182e000 10000000:01000000:2.0:1783135596.978069:0:14758:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135596.978072:0:14758:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8e0182e000 from 1 10000000:01000000:2.0:1783135596.978074:0:14758:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783135596.978108:0:14758:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39400/0xf646e0cda875da4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.978114:0:14758:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39400/0xf646e0cda875da4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.978122:0:14758:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39400/0xf646e0cda875da4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135596.978142:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319680:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135596.978198:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135596.978224:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05971c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135596.979861:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813319680 00000100:00100000:2.0:1783135596.979875:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813319680 00000100:00100000:2.0:1783135596.979943:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135596.979955:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813319680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135596.979976:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135596.979994:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f02c38a00/0xf646e0cda875da53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875da4c expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.980031:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f02c38a00/0xf646e0cda875da53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875da4c expref: 16 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.980042:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f02c38a00/0xf646e0cda875da53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875da4c expref: 16 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.980051:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38a00, rc 0) 00000100:00100000:2.0:1783135596.980120:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813319680:12345-0@lo:101:mount.lustre.0 Request processed in 168us (1920us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.980128:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783135596.980189:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319680:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135596.980205:0:14758:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39400/0xf646e0cda875da4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da53 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135596.980214:0:14758:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39400/0xf646e0cda875da4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875da53 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135596.981725:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1783135596.983200:0:14758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135596.983734:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783135596.983784:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783135596.983987:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783135596.984055:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783135596.984096:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783135596.984143:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783135596.984178:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783135596.984213:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783135596.984338:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783135596.984388:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783135596.984423:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783135596.984473:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783135596.984509:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783135596.991869:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783135596.991953:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783135596.991983:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783135596.992008:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783135596.992061:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783135596.992098:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783135596.992144:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783135596.992190:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783135596.992225:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783135596.992722:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783135596.992776:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783135596.992844:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1783135596.992882:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1783135596.992932:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1783135596.992967:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1783135596.993057:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1783135596.993065:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1783135596.993187:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135596.993555:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135596.993684:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813319808 00000100:00100000:2.0:1783135596.993692:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813319808 00000100:00100000:2.0:1783135596.993736:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135596.993745:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813319808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135596.994554:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813319808:12345-0@lo:501:mount.lustre.0 Request processed in 807us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135596.994565:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783135596.995759:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05971c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135596.995795:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135596.996386:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135596.996450:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135596.996480:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05971c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783135596.996741:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813319936 00000100:00100000:3.0:1783135596.996750:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813319936 00000100:00100000:3.0:1783135596.996802:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783135596.997184:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813319936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783135596.998119:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813319936:12345-0@lo:503:mount.lustre.0 Request processed in 1304us (1663us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135596.998138:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783135596.998360:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813319936:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135597.006362:0:14758:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135597.006458:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813320064:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135597.006552:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135597.006603:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135597.007760:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813320064 00000100:00100000:3.0:1783135597.007769:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813320064 00000100:00100000:3.0:1783135597.015353:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783135597.015371:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813320064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135597.015740:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813320064:12345-0@lo:502:mount.lustre.0 Request processed in 375us (9188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135597.015749:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783135597.016227:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813320064:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135597.016694:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1783135597.016753:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1783135597.016807:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1783135597.016991:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1783135597.017012:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1783135597.017036:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1783135597.017054:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1783135597.017070:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1783135597.017114:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1783135597.017146:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1783135597.017177:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1783135597.017224:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1783135597.017344:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1783135597.017383:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1783135597.017430:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1783135597.017464:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1783135597.017494:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1783135597.017551:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1783135597.018043:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1783135597.018092:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1783135597.018144:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1783135597.018181:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1783135597.018216:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1783135597.018362:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1783135597.018401:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1783135597.018435:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1783135597.018483:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1783135597.018533:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1783135597.018570:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1783135597.018711:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1783135597.018748:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1783135597.018779:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1783135597.018810:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1783135597.021491:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1783135597.021568:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1783135597.021694:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1783135597.021734:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1783135597.021768:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1783135597.022189:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1783135597.022312:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1783135597.022368:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813320192:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135597.022448:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135597.022497:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f03f0f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135597.022564:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813320192 00000100:00100000:3.0:1783135597.022572:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813320192 00000100:00100000:3.0:1783135597.022717:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1783135597.022728:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813320192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135597.023099:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813320192:12345-0@lo:502:mount.lustre.0 Request processed in 372us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135597.023107:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783135597.023197:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813320192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783135597.023286:0:14758:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1783135597.023297:0:14758:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1783135597.025161:0:14781:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1783135597.025179:0:14781:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8e8f3fc30000) 00000020:00000080:2.0:1783135597.025199:0:14781:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1783135597.025382:0:14781:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8e0182e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783135597.025387:0:14781:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8e0182e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1783135597.025389:0:14781:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8e0182e000 3 00010000:00080000:2.0:1783135597.025417:0:14781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8f10b6e800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.160@tcp at head 00010000:00010000:2.0:1783135597.027150:0:14781:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1783135597.027275:0:14781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1783135597.027311:0:14781:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1783135597.027325:0:14781:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xf646e0cda875da61 00000100:00080000:2.0:1783135597.027336:0:14781:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783135597.027342:0:14781:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8e8f10b6e800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:2.0:1783135597.027379:0:14781:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f3c04ad80 x1869752813320320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783135597.027416:0:14781:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1783135597.027445:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135597.027449:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783135597.027452:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135597.027455:0:37:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783135597.027520:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135597.027534:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813320448:0@lo:400:kworker.0 00000100:00100000:2.0:1783135597.027602:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135597.028676:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1869752813320320:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783135597.028729:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135597.028806:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813320448 00000100:00100000:0.0:1783135597.028960:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813320448 00000100:00100000:0.0:1783135597.029007:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813320320 00000100:00100000:0.0:1783135597.029010:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813320320 00000100:00100000:0.0:1783135597.029024:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135597.029032:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813320448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135597.029097:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813320448:12345-0@lo:400:kworker.0 Request processed in 65us (1494us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135597.029104:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135597.029126:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135597.029130:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1869752813320320:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783135597.029152:0:14123:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 496 last 0 00000020:00000080:0.0:1783135597.029188:0:14123:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xf646e0cda875da68 00000004:00100000:0.0:1783135597.029204:0:14123:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783135597.029247:0:14123:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c6f4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135597.029289:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869752813320320:12345-0@lo:38:llog_process_th.0 Request processed in 156us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135597.029295:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1783135597.029335:0:3314:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8f3c04bb80 x1869752813320448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135613 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135597.029350:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813320448:0@lo:400:kworker.0 00010000:00080000:0.0:1783135597.029385:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8e8f3c04ad80 x1869752813320320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135597.029408:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783135597.029415:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1783135597.029423:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1783135597.029428:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1783135597.029430:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f10b6e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1783135597.029436:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3310:1869752813320320:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1783135597.032536:0:14781:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1783135597.032597:0:14758:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1783135597.032637:0:14758:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783135597.032654:0:14758:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39400/0xf646e0cda875da4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da53 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.032667:0:14758:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39400/0xf646e0cda875da4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da53 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1783135597.032721:0:14758:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1783135597.032724:0:14758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135597.032725:0:14758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135597.032726:0:14758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135597.032728:0:14758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135597.032729:0:14758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135597.032731:0:14758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135597.032733:0:14758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135597.032734:0:14758:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135597.032738:0:14758:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1783135597.032741:0:14758:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135597.032742:0:14758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135597.032743:0:14758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135597.032744:0:14758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135597.032746:0:14758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135597.032747:0:14758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135597.032748:0:14758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135597.032749:0:14758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135597.032750:0:14758:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1783135597.032777:0:14758:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1783135597.032799:0:14758:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813320576:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135597.032905:0:14758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135597.032958:0:14758:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f059719c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135597.033253:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813320576 00000100:00100000:0.0:1783135597.033262:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813320576 00000100:00100000:0.0:1783135597.033310:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783135597.033319:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14758:x1869752813320576:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135597.033347:0:14116:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783135597.033364:0:14116:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783135597.072537:0:14116:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783135597.072589:0:14116:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783135597.074797:0:14139:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783135597.074806:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783135597.074841:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.074857:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 16 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.074864:0:14139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.074900:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 16 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135597.074928:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 16 pid: 14117 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135597.074941:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869752813320704:0@lo:104: 00000100:00100000:3.0:1783135597.074997:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135597.075031:0:14139:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02d9af00 going to sleep for 11 seconds 00000100:00100000:2.0:1783135597.075183:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813320704 00000100:00100000:2.0:1783135597.075191:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813320704 00000100:00100000:2.0:1783135597.075231:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135597.075363:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:14139:x1869752813320704:12345-0@lo:104: 00010000:00010000:2.0:1783135597.075377:0:14106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.075439:0:14106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135597.075445:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:14139:x1869752813320704:12345-0@lo:104: Request processed in 87us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135597.075453:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1783135597.075531:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135597.075538:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135597.075545:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d800 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:1.0:1783135597.075550:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135597.075572:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783135597.075579:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135597.075584:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783135597.075711:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135597.075716:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783135597.075733:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135597.075737:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d800/0xf646e0cda875d9d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9dc expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135597.075748:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135597.075750:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135597.075751:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135597.075799:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869752813320704:0@lo:104: 00010000:00010000:3.0:1783135597.075841:0:14139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135597.076062:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3314:1869752813320832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135597.076092:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135597.076184:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813320832 00000100:00100000:2.0:1783135597.076188:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813320832 00010000:00010000:2.0:1783135597.076202:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 17 pid: 14117 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135597.076226:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135597.076231:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:3314:x1869752813320832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135597.076247:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135597.076250:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 17 pid: 14117 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076258:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 17 pid: 14117 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076268:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f02c38800/0xf646e0cda875d9dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875d9d5 expref: 17 pid: 14117 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076278:0:14110:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076289:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135597.076301:0:14110:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001783181s 00010000:00010000:2.0:1783135597.076306:0:14110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076313:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076320:0:14110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076326:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076331:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487a00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135597.076335:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076344:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076363:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135597.076371:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135597.076401:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:3314:x1869752813320832:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135597.076407:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135597.076590:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3314:1869752813320832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135597.076701:0:14139:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.076708:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135597.076711:0:14139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3c487a00/0xf646e0cda875da6f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135597.081898:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14758:x1869752813320576:12345-0@lo:253:mount.lustre.0 Request processed in 48570us (48983us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135597.081911:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783135597.082003:0:14758:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14758:1869752813320576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135597.082015:0:14758:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783135597.082018:0:14758:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135597.082019:0:14758:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783135597.082020:0:14758:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135597.082021:0:14758:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135597.082022:0:14758:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135597.082023:0:14758:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135597.082024:0:14758:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135597.082025:0:14758:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135597.082026:0:14758:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783135597.082039:0:14758:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783135597.085671:0:14758:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135597.085795:0:14758:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135597.086014:0:14758:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135597.086126:0:14758:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135597.086218:0:14758:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135597.086420:0:14758:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1783135597.087851:0:14758:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1783135597.143946:0:14758:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1783135597.143955:0:14758:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1783135597.143995:0:14758:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1783135597.144053:0:14758:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1783135597.144067:0:14758:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1783135597.144098:0:14758:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1783135597.754959:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135598.780132:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783135598.970511:0:14120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135598.970522:0:14120:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e8f0aafe000 from 7 10000000:01000000:3.0:1783135598.970529:0:14120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135598.970608:0:14120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.970623:0:14120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.970750:0:14120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135598.970796:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813320960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135598.970948:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135598.971011:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f07a92840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135598.971243:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813320960 00000100:00100000:2.0:1783135598.971254:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813320960 00000100:00100000:2.0:1783135598.971334:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783135598.971347:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+15:14120:x1869752813320960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135598.971369:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135598.971390:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875da76 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135598.971425:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875da76 expref: 16 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135598.971439:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875da76 expref: 16 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135598.971462:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38200, rc 0) 00000100:00100000:2.0:1783135598.971523:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14120:x1869752813320960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135598.971530:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1783135598.971795:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813320960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135598.971974:0:14120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135598.971985:0:14120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135598.974151:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813321088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783135598.974254:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135598.974321:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f394dda80 going to sleep for 11 seconds 00000100:00100000:1.0:1783135598.980333:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813321088 00000100:00100000:1.0:1783135598.980353:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813321088 00000100:00100000:1.0:1783135598.980656:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783135598.980670:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14120:x1869752813321088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135598.980709:0:14116:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135598.980738:0:14116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135598.980741:0:14116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1783135598.981144:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14120:x1869752813321088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 476us (6889us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135598.981154:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783135598.984639:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3df800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813321088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783135598.984759:0:14120:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783135598.984773:0:14120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135598.984786:0:14120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135599.813738:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135600.828029:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135601.853413:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783135602.306049:0:13203:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135602.306057:0:13203:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783135602.306060:0:13203:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783135602.306063:0:13203:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783135602.306124:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813321344:0@lo:400:kworker.0 00000100:00100000:0.0:1783135602.306196:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135602.306301:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783135602.306320:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3312:1869752813321216:0@lo:400:kworker.0 00000100:00100000:0.0:1783135602.306353:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135602.306400:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813321472:0@lo:400:kworker.0 00000100:00100000:0.0:1783135602.306437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135602.306476:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813321344 00000100:00100000:0.0:1783135602.306484:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813321344 00000100:00100000:0.0:1783135602.306573:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813321472 00000100:00100000:0.0:1783135602.306577:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813321472 00000100:00100000:0.0:1783135602.306602:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135602.306610:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813321344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135602.306662:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813321344:12345-0@lo:400:kworker.0 Request processed in 53us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135602.306670:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783135602.306689:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135602.306695:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813321472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135602.306742:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813321472:12345-0@lo:400:kworker.0 Request processed in 47us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135602.306749:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135602.306767:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813321216 00000100:00100000:0.0:1783135602.306770:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813321216 00000100:00100000:0.0:1783135602.306795:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783135602.306801:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:3312:x1869752813321216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135602.306875:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:3312:x1869752813321216:12345-0@lo:400:kworker.0 Request processed in 74us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135602.306881:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1783135602.306926:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135602.306953:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3312:1869752813321216:0@lo:400:kworker.0 00010000:00080000:0.0:1783135602.306977:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3c3dea00 x1869752813321344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135602.306988:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813321344:0@lo:400:kworker.0 00010000:00080000:0.0:1783135602.307017:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3c3dfb80 x1869752813321472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135618 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135602.307026:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813321472:0@lo:400:kworker.0 00010000:00010000:0.0:1783135602.877883:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135603.900096:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783135604.411968:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1783135604.552424:0:15127:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783135604.923031:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135605.948467:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135606.970576:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135607.290018:0:3310:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135592/real 1783135592] req@ffff8e8f3c3ded80 x1869752813316992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135607 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135607.290053:0:3310:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8f3c3ded80 x1869752813316992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135607 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135607.290064:0:3310:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783135592/real 1783135592] req@ffff8e8f3c3dd500 x1869752813317120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135607 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135607.290075:0:3310:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8e8f3c3dd500 x1869752813317120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783135607 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783135607.290094:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f056f1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135607.290119:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135607.290124:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813316992:0@lo:8:kworker.0 00000100:00080000:2.0:1783135607.290129:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783135607.290134:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1783135607.290137:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813317120:0@lo:8:kworker.0 00000100:00080000:1.0:1783135607.290285:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135607.290289:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783135607.290292:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e8f056f1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135607.290297:0:37:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:1.0:1783135607.290301:0:37:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783135607.290308:0:37:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8e8f056f1000 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135607.290324:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8e03333800 x1869752813321728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783135607.290350:0:37:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783135607.290353:0:37:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783135607.290355:0:37:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783135607.290358:0:37:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:1.0:1783135607.290361:0:37:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783135607.290364:0:37:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8f122a6800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135607.290374:0:37:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8e03330700 x1869752813321856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783135607.290420:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813321984:0@lo:400:kworker.0 00000100:00100000:1.0:1783135607.290476:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135607.290523:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135607.290528:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813322112:0@lo:400:kworker.0 00000100:00100000:1.0:1783135607.290550:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135607.290643:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3314:1869752813321600:0@lo:400:kworker.0 00000100:00100000:0.0:1783135607.290673:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135607.290725:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813321984 00000100:00100000:0.0:1783135607.290731:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813321984 00000100:00100000:0.0:1783135607.290766:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813322112 00000100:00100000:0.0:1783135607.290768:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813322112 00000100:00100000:0.0:1783135607.290788:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135607.290795:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813321984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135607.290876:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813321984:12345-0@lo:400:kworker.0 Request processed in 80us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135607.290884:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783135607.290900:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783135607.290906:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813322112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135607.290927:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813322112:12345-0@lo:400:kworker.0 Request processed in 22us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135607.290945:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783135607.290965:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783135607.291001:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8e03330a80 x1869752813322112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135607.291014:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813322112:0@lo:400:kworker.0 00010000:00080000:0.0:1783135607.291022:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8e03333100 x1869752813321984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135623 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135607.291031:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813321984:0@lo:400:kworker.0 00000100:00100000:1.0:1783135607.291190:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813321600 00000100:00100000:1.0:1783135607.291201:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813321600 00000100:00100000:1.0:1783135607.291233:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783135607.291239:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:3314:x1869752813321600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135607.291269:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:3314:x1869752813321600:12345-0@lo:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135607.291275:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783135607.291365:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3314:1869752813321600:0@lo:400:kworker.0 00000100:00100000:3.0:1783135607.291573:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813321728:0@lo:8:kworker.0 00000100:00100000:3.0:1783135607.291738:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135607.291768:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813321856:0@lo:8:kworker.0 00000100:00100000:3.0:1783135607.291783:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135607.295516:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813321728 00000100:00100000:1.0:1783135607.295531:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813321728 00000100:00100000:1.0:1783135607.295560:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813321856 00000100:00100000:1.0:1783135607.295563:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813321856 00000100:00100000:1.0:1783135607.295581:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135607.295589:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1869752813321728:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783135607.295911:0:14761:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:1.0:1783135607.295948:0:14761:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875da84 00002000:00100000:1.0:1783135607.295968:0:14761:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8e8f3d619800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1783135607.295972:0:14761:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1783135607.295975:0:14761:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783135607.296320:0:14761:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783135607.296360:0:14761:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d61e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135607.296469:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1869752813321728:12345-0@lo:8:kworker.0 Request processed in 879us (4729us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135607.296478:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783135607.296501:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135607.296506:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1869752813321856:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1783135607.296517:0:14761:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1783135607.296544:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3310:x1869752813321856:12345-0@lo:8:kworker.0 Request processed in 37us (4759us total) trans 0 rc -19/-19 00000100:00100000:1.0:1783135607.296565:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783135607.297478:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8e03333800 x1869752813321728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135607.297492:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135607.297503:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1783135607.297512:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783135607.297518:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1783135607.297522:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f056f1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1783135607.297554:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783135607.297561:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813321728:0@lo:8:kworker.0 00000100:00080000:3.0:1783135607.297575:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135607.297580:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783135607.297595:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813321856:0@lo:8:kworker.0 00000004:00080000:0.0:1783135607.300782:0:14145:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783135607.301158:0:14145:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 506730341358ns, next at 0ns, rc = 0 00000004:00080000:2.0:1783135607.304668:0:14146:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1783135607.304699:0:14146:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14146:1869752813322368:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1783135607.304778:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135607.304838:0:14146:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f26472840 going to sleep for 11 seconds 00000100:00100000:2.0:1783135607.305278:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813322240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135607.305355:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135607.305499:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813322368 00000100:00100000:2.0:1783135607.305506:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813322368 00000100:00100000:2.0:1783135607.305563:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135607.305573:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14146:x1869752813322368:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1783135607.306220:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1783135607.307881:0:14762:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783135607.307890:0:14762:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1783135607.307894:0:14762:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00000100:00100000:3.0:1783135607.308701:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813322240 00000100:00100000:3.0:1783135607.308714:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813322240 00000100:00100000:3.0:1783135607.308770:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783135607.308781:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813322240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135607.308884:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135607.308972:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1869752813322240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 193us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135607.308977:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783135607.309017:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3c049880 x1869752813322240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135623 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135607.309034:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813322240:0@lo:13:osp-pre-0-0.0 00002000:00010000:2.0:1783135607.344978:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.344992:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345011:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.345016:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.345023:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345041:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345058:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345066:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345099:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135607.345115:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135607.345122:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345129:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135607.345134:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345143:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345161:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345169:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875da8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345186:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.345187:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.345189:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.345686:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.345695:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345704:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.345713:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.345717:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345727:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345736:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345743:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345763:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783135607.345773:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135607.345778:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345785:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135607.345788:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345795:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345806:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345851:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875da92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.345865:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.345867:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.345868:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.346278:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.346284:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.346293:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.346296:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.346300:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.346309:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.346317:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.346324:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.348996:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135607.349600:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.349641:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.349657:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.349662:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.349668:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.349681:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.349691:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.349698:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.355851:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135607.355869:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.355892:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135607.355897:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.355910:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.355943:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.355971:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875da99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.356173:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135607.356180:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.356187:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135607.356191:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.356200:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.356214:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.356234:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135607.356236:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135607.356238:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783135607.357101:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:2.0:1783135607.357408:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783135607.357421:0:14762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daa0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135607.358590:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.358601:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.358616:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.358621:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.360782:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.360981:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.361018:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.361028:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.361034:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.361074:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135607.361659:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.361666:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.361678:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.361681:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.361685:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.361696:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.361704:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.361718:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362486:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135607.362496:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362505:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38800 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135607.362510:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362519:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362538:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362543:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4e98701/0xf646e0cda875daa7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362573:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135607.362576:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362579:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38000 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135607.362589:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362597:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362628:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.362642:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135607.362644:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135607.362645:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.364220:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1783135607.364237:0:14762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb37ebb1/0xf646e0cda875daae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135607.370213:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.370227:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.370245:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.370250:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.370255:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.370268:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.370278:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.370286:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.370374:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135607.370382:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.370390:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135607.370395:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.370403:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.370420:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135607.370860:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135607.370864:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135607.370866:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.380659:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1783135607.380661:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.380675:0:14762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875dab5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783135607.381452:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.381462:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.381477:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.381483:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.381490:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.381505:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.381516:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.381525:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.381553:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.381711:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.381719:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.381731:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.381736:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.381747:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.381769:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.381778:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dabc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.381805:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.381808:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.381810:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.382426:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.382437:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.382455:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.382458:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.382463:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.382474:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.382483:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.382491:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.382517:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135607.383243:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135607.383464:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135607.383473:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.383484:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135607.383489:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.383499:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.383518:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.383525:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096b4812e/0xf646e0cda875dac3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.383557:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135607.383560:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135607.383564:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.384095:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.384106:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.384110:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.384114:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.384125:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.384146:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.384153:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.384180:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135607.385075:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.385084:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385095:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.385099:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.385103:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385113:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385123:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385130:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385162:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783135607.385176:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135607.385182:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385189:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135607.385194:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385204:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385221:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385230:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad3860c4/0xf646e0cda875daca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385254:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135607.385258:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385265:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135607.385270:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385289:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385303:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.385311:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dad1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135607.386204:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.386316:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.386320:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.386323:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.387218:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.387228:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.387242:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.387429:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.387436:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.387451:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.387462:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.387478:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.387502:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135607.388311:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.388322:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388347:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.388351:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.388355:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388367:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388376:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388383:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388404:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1783135607.388423:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135607.388430:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388445:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39a00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135607.388451:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388460:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388477:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388484:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082c2a6db/0xf646e0cda875dad8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388508:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135607.388511:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388517:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135607.388520:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388527:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388536:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388551:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875dadf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.388564:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.388566:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135607.388567:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.389488:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.389924:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.389933:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.389946:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.389950:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.389954:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.389966:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.389976:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.389984:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.390010:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.390196:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.390204:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390215:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.390227:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390237:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390254:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390262:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875dae6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390283:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.390285:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.390287:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.390476:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.390487:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.390495:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.390498:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.390503:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.390512:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.390521:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.390528:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.390548:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.390720:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.390726:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390734:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3800 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.390738:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390746:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390759:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390775:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f5baa52/0xf646e0cda875daed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.390789:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.390790:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.390792:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.393549:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.393567:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.393586:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.393590:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.393608:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.393623:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.393715:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.393724:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.393750:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.393938:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.393946:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.393956:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.393961:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.393971:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.393989:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.393997:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfe7c450/0xf646e0cda875daf4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.394019:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.394022:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.394024:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.394287:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.394294:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.394303:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.394306:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.394310:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.394319:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.394327:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.394345:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.394376:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.394716:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.394723:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.394730:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.394733:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.394742:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.394753:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.394759:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875dafb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.394772:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.394774:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.394775:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.397867:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.397881:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.397897:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.397901:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.397907:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.397921:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.397932:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.397938:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.397959:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.398405:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.398413:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.398423:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2800 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.398428:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.398514:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.398531:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.398538:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875db02 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.398555:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.398557:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.398558:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.398891:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.398898:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.398908:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.398918:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.398923:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.398934:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.398942:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.398949:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.398971:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.398994:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.399001:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.399010:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3000 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.399014:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.399021:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.399033:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.399051:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090fee65a/0xf646e0cda875db09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.399070:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.399073:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.399075:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.401871:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.401884:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.401900:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.401905:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.401912:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.401926:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.401937:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.401951:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.401977:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.402135:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.402142:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402149:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.402153:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402160:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402174:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402180:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098a5c3b9/0xf646e0cda875db10 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402199:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.402202:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.402205:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.402481:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.402487:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.402496:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.402499:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.402504:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.402513:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.402522:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.402528:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.402550:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.402725:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.402731:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402740:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3a00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.402742:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402748:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402757:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402762:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000034762ee7/0xf646e0cda875db17 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.402773:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.402774:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.402775:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.402982:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.402989:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403004:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.403007:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.403013:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403022:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403031:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403039:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403060:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.403364:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.403370:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403379:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.403382:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403401:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403413:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403420:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a410c23/0xf646e0cda875db1e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403438:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.403440:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.403442:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.403499:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.403506:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403514:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.403518:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.403522:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403533:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403554:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403561:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.403579:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.403600:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.403722:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403730:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2a00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.403734:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403742:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403754:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403772:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8f2897a/0xf646e0cda875db25 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.403787:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.403789:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.403791:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.407043:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.407059:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.407076:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.407081:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.407087:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.407103:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.407113:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.407122:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.407164:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.407302:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.407309:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.407319:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.407324:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.407342:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.407418:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.407425:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e6249da/0xf646e0cda875db2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.407446:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.407448:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.407450:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.408894:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.408908:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.408924:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.408928:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.408932:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.408945:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.408955:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.408963:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.408982:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.410328:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.410358:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.410371:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.410376:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.410386:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.410406:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.410413:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010be2e33/0xf646e0cda875db33 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.410430:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.410432:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.410433:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.411147:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.411158:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411170:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.411181:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.411187:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411201:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411211:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411219:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411253:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.411344:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.411359:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411368:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.411373:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411393:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411407:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411413:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4770a57/0xf646e0cda875db3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411430:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.411432:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.411434:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135607.411767:0:14762:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135607.411774:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411782:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=506s v=(0 0) 00010000:00010000:2.0:1783135607.411785:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135607.411788:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411797:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411805:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411841:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135607.411856:0:14762:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135607.411915:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135607.411922:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411930:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135607.411934:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411942:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411955:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.411984:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c52f8c59/0xf646e0cda875db41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135607.412000:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.412002:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135607.412004:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1783135607.412057:0:14762:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1783135607.412159:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14146:x1869752813322368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 106584us (107378us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135607.412169:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783135607.412274:0:14146:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14146:1869752813322368:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1783135607.412289:0:14146:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1783135607.412345:0:14146:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14146:1869752813322496:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1783135607.412451:0:14146:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135607.412497:0:14146:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3ccafcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135607.412543:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813322496 00000100:00100000:0.0:1783135607.412550:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813322496 00000100:00100000:0.0:1783135607.412590:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135607.412611:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14146:x1869752813322496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1783135607.412791:0:14760:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1783135607.430421:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03332a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14146:x1869752813322496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 17809us (17960us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783135607.430435:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783135607.430773:0:14146:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14146:1869752813322496:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783135607.430790:0:14146:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000001:00080000:0.0:1783135607.565927:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1783135607.565945:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1783135607.995059:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135609.020861:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135610.050360:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135611.069416:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1783135611.091598:0:15429:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1783135611.091602:0:15429:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1783135611.091744:0:15429:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff8e8f10b6c800 00000020:01000004:2.0:1783135611.091763:0:15429:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1783135611.091776:0:15429:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1783135611.091790:0:15429:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8e8f3fc33380) 00000020:00000080:2.0:1783135611.091807:0:15429:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783135611.111727:0:15429:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783135611.112170:0:15429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783135611.113502:0:15429:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783135611.113787:0:15429:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783135611.114223:0:15429:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783135611.115423:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 429: rc = 0 00100000:10000000:2.0:1783135611.115512:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 429: rc = 0 00100000:10000000:2.0:1783135611.115657:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 429: rc = 0 00100000:10000000:2.0:1783135611.116516:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 364: rc = 0 00100000:10000000:2.0:1783135611.117061:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 364: rc = 0 00100000:10000000:2.0:1783135611.117723:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 364: rc = 0 00100000:10000000:2.0:1783135611.118205:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 364: rc = 0 00100000:10000000:2.0:1783135611.118661:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 364: rc = 0 00100000:10000000:2.0:1783135611.119072:0:15429:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 364: rc = 0 00000020:00000080:2.0:1783135611.120063:0:15429:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1783135611.120075:0:15429:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783135611.120149:0:15429:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf646e0cda875db4f 00000020:01000004:2.0:1783135611.120158:0:15429:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1783135611.120180:0:15429:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783135611.120184:0:15429:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783135611.120190:0:15429:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1783135611.120213:0:15429:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1783135611.120217:0:15429:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1783135611.132972:0:15429:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1783135611.133012:0:15429:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.160@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1783135611.133016:0:15429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1783135611.133018:0:15429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135611.133020:0:15429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135611.133021:0:15429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135611.133022:0:15429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135611.133024:0:15429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135611.133025:0:15429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135611.133027:0:15429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135611.133028:0:15429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135611.133032:0:15429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1783135611.133034:0:15429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1783135611.133036:0:15429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135611.133037:0:15429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135611.133038:0:15429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135611.133039:0:15429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135611.133040:0:15429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135611.133041:0:15429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135611.133046:0:15429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135611.133047:0:15429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1783135611.133075:0:15429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1783135611.133166:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813322624:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783135611.133241:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.133493:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200d80 going to sleep for 11 seconds 00000100:00100000:3.0:1783135611.133541:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813322624 00000100:00100000:3.0:1783135611.133549:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813322624 00000100:00100000:3.0:1783135611.133706:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783135611.133716:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:15429:x1869752813322624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783135611.133747:0:14117:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1783135611.133750:0:14117:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1783135611.133754:0:14117:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1783135611.145689:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:15429:x1869752813322624:12345-0@lo:253:mount.lustre.0 Request processed in 11966us (12439us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.145704:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783135611.145787:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813322624:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1783135611.145802:0:15429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1783135611.145805:0:15429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783135611.145807:0:15429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1783135611.145808:0:15429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783135611.145810:0:15429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783135611.145811:0:15429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783135611.145913:0:15429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783135611.145914:0:15429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783135611.145916:0:15429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783135611.145917:0:15429:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1783135611.145951:0:15429:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8e8f10b6c800 from lustre-OST0001 10000000:01000000:2.0:1783135611.146002:0:15429:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1783135611.146004:0:15429:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783135611.146013:0:15429:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8e8f05393380 local copy 00010000:00010000:2.0:1783135611.146024:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135611.146412:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813322752:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135611.146452:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.146527:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200840 going to sleep for 11 seconds 00000100:00100000:0.0:1783135611.146557:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813322752 00000100:00100000:0.0:1783135611.146563:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813322752 00000100:00100000:0.0:1783135611.146626:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783135611.146634:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:15429:x1869752813322752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135611.146889:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:15429:x1869752813322752:12345-0@lo:501:mount.lustre.0 Request processed in 255us (436us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135611.146896:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783135611.146980:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813322752:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1783135611.146992:0:15429:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1783135611.147122:0:15429:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1783135611.147128:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.147143:0:15429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f02c39000/0xf646e0cda875d8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875d903 expref: -99 pid: 14105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135611.147163:0:15429:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8e8f10b6c800 10000000:01000000:2.0:1783135611.147167:0:15429:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783135611.147171:0:15429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1783135611.147173:0:15429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783135611.147178:0:15429:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1783135611.147181:0:15429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1783135611.147198:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875db56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.147205:0:15429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875db56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.147214:0:15429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875db56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135611.147225:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813322880:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135611.147247:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.147832:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200840 going to sleep for 11 seconds 00000100:00100000:1.0:1783135611.147902:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813322880 00000100:00100000:1.0:1783135611.147907:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813322880 00000100:00100000:1.0:1783135611.147933:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783135611.147938:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:15429:x1869752813322880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783135611.147948:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135611.147959:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875db5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875db56 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135611.147979:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875db5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875db56 expref: 17 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135611.147995:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121d200/0xf646e0cda875db5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875db56 expref: 17 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135611.148004:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d200, rc 0) 00000100:00100000:1.0:1783135611.148040:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813322880:12345-0@lo:101:mount.lustre.0 Request processed in 101us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.148046:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783135611.148120:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813322880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135611.148132:0:15429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875db56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db5d expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.148141:0:15429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875db56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875db5d expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135611.148710:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1783135611.149540:0:15429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135611.149763:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1783135611.149804:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1783135611.149877:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1783135611.149923:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1783135611.149955:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1783135611.149985:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1783135611.150041:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1783135611.150048:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1783135611.150128:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135611.150184:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.150216:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135611.150552:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813323008 00000100:00100000:1.0:1783135611.150559:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813323008 00000100:00100000:1.0:1783135611.150593:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783135611.150601:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783135611.151036:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323008:12345-0@lo:501:mount.lustre.0 Request processed in 433us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.151044:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783135611.151873:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135611.151933:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135611.151985:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.152008:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135611.152062:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813323136 00000100:00100000:1.0:1783135611.152067:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813323136 00000100:00100000:1.0:1783135611.152108:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783135611.152117:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135611.152624:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323136:12345-0@lo:503:mount.lustre.0 Request processed in 507us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.152633:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783135611.152800:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135611.153938:0:15429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135611.154013:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135611.154069:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.154181:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135611.154253:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813323264 00000100:00100000:1.0:1783135611.154259:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813323264 00000100:00100000:1.0:1783135611.154446:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783135611.154456:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135611.154666:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323264:12345-0@lo:502:mount.lustre.0 Request processed in 210us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.154680:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783135611.154850:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135611.155104:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783135611.155154:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783135611.155198:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783135611.155247:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783135611.155483:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783135611.155524:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783135611.155586:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783135611.155623:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783135611.155686:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1783135611.155719:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135611.155767:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.155803:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783135611.155923:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813323392 00000100:00100000:1.0:1783135611.155929:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813323392 00000100:00100000:1.0:1783135611.156018:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783135611.156027:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135611.156190:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323392:12345-0@lo:502:mount.lustre.0 Request processed in 163us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.156197:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783135611.156304:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135611.156364:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1783135611.156374:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1783135611.157764:0:15430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783135611.157775:0:15430:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1783135611.157782:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135611.157784:0:15430:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1783135611.157792:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783135611.157808:0:15430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8e8f09d0cd40) 00000020:00000080:3.0:1783135611.157936:0:15430:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1783135611.157944:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1783135611.158041:0:15430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8f10b6c800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1783135611.158049:0:15430:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783135611.158055:0:15430:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xf646e0cda875db6b 00010000:00010000:3.0:1783135611.162256:0:15430:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1783135611.162776:0:15430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1783135611.164971:0:15430:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1783135611.166885:0:15430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1783135611.166904:0:15430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135611.166911:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135611.166913:0:15430:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1783135611.166916:0:15430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135611.166920:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135611.166921:0:15430:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783135611.166925:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783135611.166927:0:15430:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783135611.166929:0:15430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135611.166931:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135611.166932:0:15430:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783135611.166934:0:15430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783135611.166937:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135611.166938:0:15430:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783135611.166942:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1783135611.166997:0:15430:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783135611.167001:0:15430:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783135611.167003:0:15430:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783135611.167006:0:15430:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1783135611.167512:0:15429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1783135611.167544:0:15429:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783135611.167565:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875db56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db5d expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.167578:0:15429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3600/0xf646e0cda875db56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db5d expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135611.167585:0:15429:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f10b6c800 from 1 10000000:01000000:2.0:1783135611.167588:0:15429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135611.167622:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.167630:0:15429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.167641:0:15429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135611.167671:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783135611.167738:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.167777:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135611.170922:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813323520 00000100:00100000:0.0:1783135611.170940:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813323520 00000100:00100000:0.0:1783135611.170999:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783135611.171008:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:15429:x1869752813323520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783135611.171027:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135611.171044:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875db72 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.171072:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875db72 expref: 18 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.171153:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875db72 expref: 18 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.171165:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043c00, rc 0) 00000100:00100000:0.0:1783135611.171252:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813323520:12345-0@lo:101:mount.lustre.0 Request processed in 245us (3514us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135611.171259:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783135611.171894:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783135611.171914:0:15429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.171924:0:15429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783135611.172664:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783135611.173619:0:15429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783135611.175936:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783135611.176016:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783135611.176079:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783135611.176227:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783135611.176427:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135611.176495:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.177953:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135611.181061:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813323648 00000100:00100000:3.0:1783135611.181072:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813323648 00000100:00100000:3.0:1783135611.181204:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783135611.181214:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813323648:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135611.182194:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813323648:12345-0@lo:501:mount.lustre.0 Request processed in 977us (5693us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135611.182205:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783135611.182357:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135611.182423:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783135611.182471:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.182542:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135611.182577:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813323776 00000100:00100000:1.0:1783135611.182582:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813323776 00000100:00100000:1.0:1783135611.182654:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783135611.182663:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813323776:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135611.182984:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813323776:12345-0@lo:503:mount.lustre.0 Request processed in 322us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.182992:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783135611.183068:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783135611.183573:0:15429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783135611.183641:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135611.183678:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.184121:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052000c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135611.184190:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813323904 00000100:00100000:0.0:1783135611.184196:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813323904 00000100:00100000:1.0:1783135611.184238:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783135611.184248:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813323904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135611.184448:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813323904:12345-0@lo:502:mount.lustre.0 Request processed in 201us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.184456:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783135611.184528:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813323904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135611.184776:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1783135611.184852:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1783135611.184902:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1783135611.184936:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1783135611.184966:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1783135611.185029:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1783135611.185064:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1783135611.185111:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1783135611.185137:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783135611.185179:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.185545:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052000c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135611.185580:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813324032 00000100:00100000:3.0:1783135611.185586:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813324032 00000100:00100000:3.0:1783135611.185617:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783135611.185626:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813324032:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135611.185784:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c232450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813324032:12345-0@lo:502:mount.lustre.0 Request processed in 158us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135611.185798:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783135611.185906:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783135611.185986:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1783135611.185996:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1783135611.186791:0:15434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135611.186802:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135611.186804:0:15434:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783135611.186811:0:15434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8f10b6c800 00000020:00000080:2.0:1783135611.186844:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135611.186852:0:15434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135611.186855:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135611.186856:0:15434:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1783135611.186859:0:15434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135611.186861:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135611.186862:0:15434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783135611.186865:0:15434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff8e8f10b6c800 00000020:00000080:2.0:1783135611.186875:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135611.186929:0:15434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135611.186932:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135611.186933:0:15434:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1783135611.186936:0:15434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783135611.186938:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135611.186939:0:15434:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1783135611.186943:0:15434:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8e8f10b6c800 00000020:00000080:2.0:1783135611.186945:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783135611.186980:0:15434:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783135611.186983:0:15434:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783135611.186985:0:15434:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783135611.186987:0:15434:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1783135611.187125:0:15429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783135611.187145:0:15429:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135611.187168:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135611.187179:0:15429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783135611.187224:0:15429:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783135611.187227:0:15429:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8e8f10b6c800 10000000:01000000:3.0:1783135611.187230:0:15429:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8e8f10b6c800 10000000:01000000:3.0:1783135611.187235:0:15429:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783135611.187240:0:15429:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff8e8f10b6c800 from 1 10000000:01000000:3.0:1783135611.187243:0:15429:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783135611.187279:0:15429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487200/0xf646e0cda875db80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135611.187294:0:15429:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487200/0xf646e0cda875db80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135611.187304:0:15429:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487200/0xf646e0cda875db80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135611.187322:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324160:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783135611.187372:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135611.187403:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813324160 00000100:00100000:3.0:1783135611.187409:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813324160 00000100:00100000:3.0:1783135611.187438:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135611.187455:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813324160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135611.187467:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135611.187477:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3c486200/0xf646e0cda875db87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875db80 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135611.187499:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3c486200/0xf646e0cda875db87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875db80 expref: 19 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135611.187511:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3c486200/0xf646e0cda875db87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875db80 expref: 19 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135611.187519:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3c486200, rc 0) 00000100:00100000:3.0:1783135611.187546:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd22c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324160:12345-0@lo:101:mount.lustre.0 Request processed in 92us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135611.187553:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783135611.187588:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f264726c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135611.187605:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324160:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783135611.187617:0:15429:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487200/0xf646e0cda875db80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db87 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135611.187625:0:15429:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487200/0xf646e0cda875db80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875db87 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135611.188207:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1783135611.188515:0:15429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135611.188748:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1783135611.188792:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1783135611.188876:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1783135611.188921:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1783135611.188961:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1783135611.189002:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1783135611.189034:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1783135611.189068:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1783135611.189115:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1783135611.189152:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1783135611.189187:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1783135611.189246:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1783135611.189298:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1783135611.189333:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1783135611.189382:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1783135611.189419:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1783135611.189453:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1783135611.189499:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1783135611.189549:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1783135611.189584:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1783135611.189630:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1783135611.189663:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1783135611.189695:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1783135611.189740:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1783135611.189774:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1783135611.189809:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1783135611.189890:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1783135611.189926:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1783135611.189959:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1783135611.190004:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1783135611.192029:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1783135611.192184:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1783135611.192224:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1783135611.192374:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1783135611.192427:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1783135611.192478:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1783135611.192513:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1783135611.192615:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1783135611.192624:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1783135611.192751:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324288:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783135611.193908:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135611.195224:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f264726c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135611.201064:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813324288 00000100:00100000:2.0:1783135611.201417:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813324288 00000100:00100000:2.0:1783135611.201506:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783135611.201516:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783135611.201974:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd22050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324288:12345-0@lo:501:mount.lustre.0 Request processed in 456us (8067us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135611.201983:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783135611.204655:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783135611.204729:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783135611.204805:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135611.205976:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3ccaf540 going to sleep for 11 seconds 00000100:00100000:1.0:1783135611.206203:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813324416 00000100:00100000:1.0:1783135611.206211:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813324416 00000100:00100000:1.0:1783135611.206262:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783135611.207033:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324416:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783135611.207669:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd23450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324416:12345-0@lo:503:mount.lustre.0 Request processed in 1386us (2860us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.207684:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783135611.207776:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324416:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783135611.209742:0:15429:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783135611.209898:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03332300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324544:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783135611.209972:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135611.210052:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09356240 going to sleep for 11 seconds 00000100:00100000:3.0:1783135611.213403:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813324544 00000100:00100000:3.0:1783135611.213420:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813324544 00000100:00100000:3.0:1783135611.213483:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135611.213495:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324544:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135611.213872:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd21450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324544:12345-0@lo:502:mount.lustre.0 Request processed in 379us (3899us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135611.213880:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783135611.213945:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03332300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135611.215525:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783135611.215598:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783135611.215632:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783135611.215677:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783135611.215711:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783135611.215762:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783135611.215797:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783135611.217234:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783135611.217401:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783135611.217437:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783135611.217469:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783135611.217509:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783135611.217560:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783135611.217593:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783135611.217651:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783135611.217685:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783135611.217704:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783135611.217740:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783135611.217761:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783135611.217789:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783135611.217848:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783135611.217884:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783135611.217904:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783135611.217930:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783135611.217947:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1783135611.217963:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1783135611.217986:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1783135611.218003:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1783135611.218032:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1783135611.218057:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1783135611.218075:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1783135611.218749:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1783135611.218772:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1783135611.218803:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1783135611.218855:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1783135611.218887:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1783135611.218905:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1783135611.218921:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1783135611.218944:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1783135611.218961:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1783135611.219001:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783135611.219072:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135611.219122:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f264726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135611.219164:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813324672 00000100:00100000:0.0:1783135611.219172:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813324672 00000100:00100000:0.0:1783135611.219223:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783135611.219232:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783135611.219475:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd23050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324672:12345-0@lo:502:mount.lustre.0 Request processed in 243us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135611.219482:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783135611.219860:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783135611.219943:0:15429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1783135611.219957:0:15429:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1783135611.221045:0:15439:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1783135611.221059:0:15439:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8e8f10b64d40) 00000020:00000080:1.0:1783135611.221076:0:15439:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1783135611.221251:0:15439:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8e8f10b6c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783135611.221255:0:15439:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8e8f10b6c800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1783135611.221258:0:15439:0:(obd_mount.c:701:lustre_put_lsi()) put ffff8e8f10b6c800 3 00010000:00080000:1.0:1783135611.221419:0:15439:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8e8e02ebe000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.160@tcp at head 00010000:00010000:1.0:1783135611.223963:0:15439:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1783135611.224046:0:15439:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1783135611.224073:0:15439:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783135611.224147:0:15439:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xf646e0cda875db95 00000100:00080000:1.0:1783135611.224159:0:15439:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783135611.224165:0:15439:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8e8e02ebe000 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:1.0:1783135611.224195:0:15439:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8e03330380 x1869752813324800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783135611.224241:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1869752813324800:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783135611.224388:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783135611.224449:0:15439:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783135611.224513:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813324800 00000100:00100000:0.0:1783135611.224519:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813324800 00000100:00100000:0.0:1783135611.224558:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135611.224566:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3310:x1869752813324800:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783135611.224588:0:14123:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:0.0:1783135611.224616:0:14123:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xf646e0cda875db9c 00000004:00100000:0.0:1783135611.224631:0:14123:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783135611.224659:0:14123:0:(import.c:65:import_set_state_nolock()) ffff8e8f3c6f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135611.224783:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869752813324800:12345-0@lo:38:llog_process_th.0 Request processed in 216us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135611.224806:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1783135611.225161:0:15439:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1783135611.225485:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8e03330380 x1869752813324800/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783135621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135611.225495:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135611.225505:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1783135611.225511:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1783135611.225516:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783135611.225518:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8e02ebe000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783135611.225524:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3310:1869752813324800:0@lo:38:llog_process_th.0 00000020:01000000:3.0:1783135611.225552:0:15429:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783135611.225584:0:15429:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783135611.225676:0:15429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487200/0xf646e0cda875db80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db87 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135611.225687:0:15429:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487200/0xf646e0cda875db80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875db87 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783135611.225730:0:15429:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783135611.225732:0:15429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135611.225734:0:15429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135611.225735:0:15429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135611.225736:0:15429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135611.225737:0:15429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135611.225739:0:15429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135611.225741:0:15429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135611.225742:0:15429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135611.225746:0:15429:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783135611.225749:0:15429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783135611.225754:0:15429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135611.225755:0:15429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135611.225756:0:15429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135611.225757:0:15429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135611.225758:0:15429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135611.225759:0:15429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135611.225760:0:15429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135611.225761:0:15429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783135611.225776:0:15429:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783135611.225789:0:15429:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324928:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783135611.225854:0:15429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135611.225883:0:15429:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04ee09c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135611.225973:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813324928 00000100:00100000:0.0:1783135611.225979:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813324928 00000100:00100000:0.0:1783135611.226017:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783135611.226025:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:15429:x1869752813324928:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783135611.226048:0:14118:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783135611.226061:0:14118:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:2.0:1783135611.226413:0:13203:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135611.226417:0:13203:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135611.226420:0:13203:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135611.226426:0:13203:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 506 00000100:00080000:2.0:1783135611.226430:0:13203:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1783135611.226434:0:13203:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8f122a6800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:2.0:1783135611.226452:0:13203:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f3c049500 x1869752813325184/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135611.226494:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813325056:0@lo:400:kworker.0 00000100:00100000:2.0:1783135611.226535:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135611.226602:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813325312:0@lo:400:kworker.0 00000100:00100000:0.0:1783135611.226631:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.226638:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813325056 00000100:00100000:2.0:1783135611.226642:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813325056 00000100:00100000:0.0:1783135611.226656:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783135611.226662:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813325440:0@lo:400:kworker.0 00000100:00100000:2.0:1783135611.226682:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135611.226682:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.226690:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813325056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135611.226725:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813325312 00000100:00100000:2.0:1783135611.226729:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813325056:12345-0@lo:400:kworker.0 Request processed in 40us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135611.226729:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813325312 00000100:00100000:2.0:1783135611.226736:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783135611.226747:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813325440 00000100:00100000:0.0:1783135611.226750:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813325440 00000100:00080000:2.0:1783135611.226753:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135611.226756:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135611.226764:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135611.226770:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813325312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135611.226773:0:3314:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783135611.226784:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813325056:0@lo:400:kworker.0 00000100:00100000:0.0:1783135611.226801:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813325312:12345-0@lo:400:kworker.0 Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135611.226807:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783135611.226840:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135611.226846:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813325440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135611.226872:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813325440:12345-0@lo:400:kworker.0 Request processed in 27us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135611.226887:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135611.227207:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813325184:0@lo:8:kworker.0 00000100:00100000:3.0:1783135611.227235:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135611.227279:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813325184 00000100:00100000:3.0:1783135611.227347:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813325184 00000100:00100000:3.0:1783135611.227371:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135611.227376:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1869752813325184:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783135611.227430:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1869752813325184:12345-0@lo:8:kworker.0 Request processed in 52us (194us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783135611.227437:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783135611.227462:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783135611.227467:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783135611.227471:0:3310:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783135611.227474:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813325184:0@lo:8:kworker.0 00010000:00080000:0.0:1783135611.227588:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3c048380 x1869752813325440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135611.227598:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813325440:0@lo:400:kworker.0 00010000:00080000:0.0:1783135611.227607:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8e8f3c04b100 x1869752813325312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135627 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783135611.227615:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813325312:0@lo:400:kworker.0 20000000:01000000:0.0:1783135611.242586:0:14118:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783135611.242606:0:14118:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783135611.242695:0:14139:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783135611.242700:0:14139:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783135611.242723:0:14139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.242743:0:14139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875da76 expref: 19 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.242752:0:14139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.242791:0:14139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875da76 expref: 19 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.242804:0:14139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875da76 expref: 19 pid: 14117 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135611.242905:0:14139:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869752813325568:0@lo:104: 00000100:00100000:2.0:1783135611.242983:0:14139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.243028:0:14139:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f02bf6240 going to sleep for 11 seconds 00000100:00100000:1.0:1783135611.243121:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813325568 00000100:00100000:1.0:1783135611.243129:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813325568 00000100:00100000:1.0:1783135611.243185:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783135611.243194:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:14139:x1869752813325568:12345-0@lo:104: 00010000:00010000:1.0:1783135611.243205:0:14106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135611.243278:0:14106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783135611.243285:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:14139:x1869752813325568:12345-0@lo:104: Request processed in 92us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135611.243293:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135611.243369:0:14139:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04a300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14139:1869752813325568:0@lo:104: 00010000:00010000:2.0:1783135611.243389:0:14139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.243489:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135611.243496:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.243503:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:0.0:1783135611.243506:0:14111:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.243515:0:14111:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783135611.243522:0:14111:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135611.243527:0:14111:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783135611.243561:0:14111:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.243578:0:14111:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783135611.243597:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.243604:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487c00/0xf646e0cda875da76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875da7d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135611.243619:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135611.243621:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135611.243622:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135611.243633:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3313:1869752813325696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135611.243663:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135611.244226:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813325696 00000100:00100000:2.0:1783135611.244232:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813325696 00010000:00010000:2.0:1783135611.244256:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875da76 expref: 20 pid: 14117 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135611.244297:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135611.244306:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+20:3313:x1869752813325696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135611.244316:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135611.244321:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875da76 expref: 20 pid: 14117 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244330:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875da76 expref: 20 pid: 14117 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244344:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875da7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875da76 expref: 20 pid: 14117 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244358:0:14110:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244366:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783135611.244378:0:14110:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001783181s 00010000:00010000:2.0:1783135611.244389:0:14110:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244396:0:14110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244402:0:14110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244408:0:14110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244413:0:14110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135611.244418:0:14110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.244426:0:14110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135611.244582:0:14139:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135611.244590:0:14139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.245101:0:14110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.245111:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b3c00/0xf646e0cda875dba3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135611.245127:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135611.245184:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3313:x1869752813325696:12345-0@lo:103:ldlm_bl.0 Request processed in 879us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135611.245192:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135611.245258:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3313:1869752813325696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783135611.255160:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd20850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:15429:x1869752813324928:12345-0@lo:253:mount.lustre.0 Request processed in 29124us (29294us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135611.255175:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783135611.255260:0:15429:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:15429:1869752813324928:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783135611.255291:0:15429:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783135611.255294:0:15429:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783135611.255296:0:15429:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783135611.255297:0:15429:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783135611.255313:0:15429:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783135611.255314:0:15429:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783135611.255316:0:15429:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783135611.255317:0:15429:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783135611.255319:0:15429:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783135611.255321:0:15429:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783135611.255335:0:15429:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783135611.259697:0:15429:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135611.260352:0:15429:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135611.260540:0:15429:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135611.260699:0:15429:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783135611.260932:0:15429:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783135611.261139:0:15429:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783135611.261796:0:15429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783135611.320313:0:15429:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783135611.320324:0:15429:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783135611.320357:0:15429:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783135611.320415:0:15429:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.160@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783135611.320430:0:15429:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783135611.320462:0:15429:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783135612.090407:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135612.538124:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813325824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135612.538215:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135612.539286:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813325824 00000100:00100000:3.0:1783135612.539298:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813325824 00000100:00100000:3.0:1783135612.539368:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783135612.539378:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813325824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783135612.539416:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135612.539483:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813325824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135612.539491:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135612.539710:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813325824:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1783135612.923002:0:14120:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783135612.923012:0:14120:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff8e8f0aafe000 from 8 10000000:01000000:3.0:1783135612.923018:0:14120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783135612.923068:0:14120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487a00/0xf646e0cda875dbaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135612.923080:0:14120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487a00/0xf646e0cda875dbaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135612.923092:0:14120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487a00/0xf646e0cda875dbaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135612.923117:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813325952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783135612.924073:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135612.924137:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3db37300 going to sleep for 11 seconds 00000100:00100000:1.0:1783135612.924212:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813325952 00000100:00100000:1.0:1783135612.924221:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813325952 00000100:00100000:1.0:1783135612.924285:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783135612.924294:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:14120:x1869752813325952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135612.924312:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135612.924339:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121d600/0xf646e0cda875dbb1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875dbaa expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135612.924367:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121d600/0xf646e0cda875dbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875dbaa expref: 19 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135612.924378:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121d600/0xf646e0cda875dbb1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875dbaa expref: 19 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135612.924388:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d600, rc 0) 00000100:00100000:1.0:1783135612.924435:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd23c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:14120:x1869752813325952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135612.924442:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1783135612.924495:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813325952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135612.924509:0:14120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487a00/0xf646e0cda875dbaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dbb1 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135612.924519:0:14120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487a00/0xf646e0cda875dbaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875dbb1 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135612.924572:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813326080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783135612.924603:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135612.924617:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f052000c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135612.924629:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813326080 00000100:00100000:1.0:1783135612.924632:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813326080 00000100:00100000:1.0:1783135612.924650:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783135612.924655:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:14120:x1869752813326080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783135612.924668:0:14118:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783135612.924682:0:14118:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783135612.924685:0:14118:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1783135612.924747:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd23850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:14120:x1869752813326080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 91us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135612.924754:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1783135612.924777:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813326080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1783135612.924853:0:14120:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783135612.924860:0:14120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487a00/0xf646e0cda875dbaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dbb1 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135612.924868:0:14120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3c487a00/0xf646e0cda875dbaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dbb1 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135613.115006:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135614.138893:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783135614.651569:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783135615.163594:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.186752:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783135616.634310:0:13203:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783135616.634317:0:13203:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783135616.634321:0:13203:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783135616.634336:0:13203:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8e8f122a6800 using connection 192.168.201.160@tcp/0@lo 00000100:00100000:2.0:1783135616.634363:0:13203:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8e8f3c048700 x1869752813326464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783135616.634459:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813326336:0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.634541:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135616.634605:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783135616.634612:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3312:1869752813326208:0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.634646:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135616.634666:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813326848:0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.634704:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135616.634727:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813326464:0@lo:8:kworker.0 00000100:00100000:2.0:1783135616.634748:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135616.634768:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813326592:0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.634789:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135616.634810:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783135616.634836:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813326336 00000100:00100000:2.0:1783135616.634842:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813326720:0@lo:400:kworker.0 00000100:00100000:3.0:1783135616.634848:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813326336 00000100:00100000:2.0:1783135616.634875:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135616.634905:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813326464 00000100:00100000:2.0:1783135616.634909:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813326464 00000100:00100000:2.0:1783135616.634941:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135616.634949:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3310:x1869752813326464:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783135616.634979:0:14760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 516 last 0 00000020:00000080:2.0:1783135616.635008:0:14760:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xf646e0cda875dbb8 00002000:00100000:2.0:1783135616.635023:0:14760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8e8f3d513000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113654 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783135616.635027:0:14760:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1783135616.635031:0:14760:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1783135616.635043:0:14762:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783135616.635052:0:14762:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1783135616.635396:0:14760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783135616.635420:0:14760:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d514000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135616.635473:0:14761:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1783135616.635489:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135616.635491:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1869752813326464:12345-0@lo:8:kworker.0 Request processed in 538us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135616.635501:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813326336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.635504:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135616.635540:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813326208 00000100:00100000:2.0:1783135616.635544:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813326208 00000100:00100000:0.0:1783135616.635562:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813326336:12345-0@lo:400:kworker.0 Request processed in 64us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135616.635569:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783135616.635578:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783135616.635589:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3312:x1869752813326208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.635630:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3312:x1869752813326208:12345-0@lo:400:kworker.0 Request processed in 44us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135616.635636:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783135616.635667:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813326848 00000100:00100000:2.0:1783135616.635671:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813326848 00000100:00100000:2.0:1783135616.635689:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813326592 00000100:00100000:2.0:1783135616.635692:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813326592 00000100:00100000:2.0:1783135616.635702:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813326720 00000100:00100000:2.0:1783135616.635704:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813326720 00000100:00100000:2.0:1783135616.635716:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135616.635721:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813326848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.635748:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869752813326848:12345-0@lo:400:kworker.0 Request processed in 27us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135616.635756:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783135616.635769:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783135616.635777:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813326592:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1783135616.635801:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c048700 x1869752813326464/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783135641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135616.635836:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813326592:12345-0@lo:400:kworker.0 Request processed in 36us (1020us total) trans 0 rc 0/0 00000100:00080000:3.0:1783135616.635838:0:3310:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00100000:2.0:1783135616.635847:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1783135616.635849:0:3310:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1783135616.635855:0:3310:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1783135616.635858:0:3310:0:(import.c:65:import_set_state_nolock()) ffff8e8f122a6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1783135616.635863:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135616.635871:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813326720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.635899:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869752813326720:12345-0@lo:400:kworker.0 Request processed in 29us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135616.635904:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1783135616.635927:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783135616.635931:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1783135616.636001:0:3310:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1783135616.636008:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3310:1869752813326464:0@lo:8:kworker.0 00000004:00080000:3.0:1783135616.636059:0:14148:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1783135616.636078:0:14148:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14148:1869752813327104:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1783135616.636111:0:14148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135616.636129:0:14148:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262300 going to sleep for 11 seconds 00000100:00100000:3.0:1783135616.636140:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135616.636147:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813326976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135616.636179:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135616.636208:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813326976 00000100:00100000:3.0:1783135616.636211:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813326976 00010000:00080000:2.0:1783135616.636221:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c048380 x1869752813326720/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135616.636242:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3313:1869752813326720:0@lo:400:kworker.0 00000100:00100000:3.0:1783135616.636245:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783135616.636259:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813326976:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1783135616.636267:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c04b100 x1869752813326592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135616.636277:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813326592:0@lo:400:kworker.0 00002000:00000024:3.0:1783135616.636282:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1783135616.636299:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135616.636324:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869752813326976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135616.636331:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783135616.636359:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8e026e5880 x1869752813326976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783135632 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783135616.636386:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813326976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135616.636438:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c048a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3312:1869752813326208:0@lo:400:kworker.0 00010000:00080000:2.0:1783135616.636452:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8e8f3c049500 x1869752813326848/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783135632 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783135616.636462:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3312:1869752813326848:0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.636476:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c04b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813326336:0@lo:400:kworker.0 00000100:00100000:2.0:1783135616.636500:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813327104 00000100:00100000:2.0:1783135616.636504:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813327104 00000100:00100000:2.0:1783135616.636530:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135616.636537:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14148:x1869752813327104:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783135616.636803:0:14147:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783135616.637397:0:14147:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 516066580091ns, next at 0ns, rc = 0 00002000:00080000:2.0:1783135616.640385:0:14760:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1783135616.640397:0:14760:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1783135616.640403:0:14760:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1783135616.657047:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.657063:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.657083:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.657089:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.657096:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.657117:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.657128:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.657135:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.657168:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135616.657827:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135616.657836:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.657846:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.657851:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.657860:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135616.658102:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.658111:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.658120:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.658123:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.658136:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.658148:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.658157:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.658163:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.658191:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135616.658765:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.658776:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dbbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.658798:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135616.658802:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.658809:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.658812:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.658852:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.658864:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.658871:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dbc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.659018:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.659020:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.659022:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.660194:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.660206:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.660221:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.660225:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.660231:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.660243:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.660253:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.660275:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.660294:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135616.661011:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.661021:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.661033:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.661035:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.661039:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.661048:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.661055:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.661061:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.661068:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783135616.661561:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135616.661569:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661578:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.661583:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661593:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661613:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661636:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dbcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661658:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135616.661662:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661669:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.661672:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661680:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661692:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661699:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dbd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.661712:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.661714:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.661716:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.663768:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.663780:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.663803:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.663807:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.663836:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.663852:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.663863:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.663872:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.666192:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135616.667008:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135616.667018:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.667037:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486000 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.667041:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.667052:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.667071:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.667078:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dbdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.667097:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.667099:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.667100:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783135616.670331:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135616.670349:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.670367:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1783135616.670379:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135616.670386:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.670407:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.670420:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.670427:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.670453:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1783135616.671276:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135616.671286:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671297:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1783135616.671300:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135616.671304:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671314:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671324:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671337:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671347:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1783135616.671760:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783135616.671766:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671779:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=516s v=(0 0) 00010000:00010000:2.0:1783135616.671782:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135616.671786:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671794:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671802:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671808:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135616.671843:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783135616.673235:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783135616.673248:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673263:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.673267:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673278:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673306:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673314:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a410c23/0xf646e0cda875dbe2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673341:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135616.673345:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673352:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3a00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.673355:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673363:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673374:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673381:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034762ee7/0xf646e0cda875dbe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673393:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135616.673397:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673411:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.673414:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673423:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673435:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673443:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098a5c3b9/0xf646e0cda875dbf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.673458:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.673461:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.673463:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.677070:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.687541:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.687558:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.687580:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.687585:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.687592:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.687607:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.687630:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.687639:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.687671:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783135616.688782:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135616.688794:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.688806:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.688811:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.688838:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.688867:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.688886:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094067e74/0xf646e0cda875dbf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.688917:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.688920:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.688922:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.696533:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.696545:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696562:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.696565:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.696571:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696585:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696594:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696601:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696636:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135616.696652:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135616.696658:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696666:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135616.696671:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696681:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696700:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696706:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089fa8dc1/0xf646e0cda875dbfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.696725:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.696727:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.696729:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.700847:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.700861:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.700878:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.700889:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.700895:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.701193:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.701207:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.701214:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.701287:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135616.701781:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.701788:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.701798:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.701801:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.701804:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.701839:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.701848:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.701861:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704576:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135616.704591:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704606:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486a00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.704611:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704623:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704651:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704659:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005108e2d6/0xf646e0cda875dc05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704681:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135616.704685:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704691:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487800 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.704694:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704700:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704718:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.704726:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.704728:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.704731:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.704851:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.704859:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d574c95/0xf646e0cda875dc0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135616.705523:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.705531:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.705543:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.705547:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.705554:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.705566:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.705575:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.705582:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.706065:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135616.706072:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.706082:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.706087:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.706097:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.706112:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.706121:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.706123:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.706124:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.706212:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.706218:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000090ea6c56/0xf646e0cda875dc13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135616.706730:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.706737:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.706747:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.706751:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.706756:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.706766:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.706773:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.706780:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.707018:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135616.707025:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.707044:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487000 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.707047:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.707056:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.707068:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.707077:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.707080:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.707081:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.707165:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.707180:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c60cd933/0xf646e0cda875dc1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135616.707600:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.707607:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.707616:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.707620:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.707624:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.707634:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.707642:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.707649:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.707735:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135616.708129:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.708135:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.708143:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.708146:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.708155:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.708164:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.708185:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.708192:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708358:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783135616.708364:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708373:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486000 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.708377:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708386:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708400:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708408:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004bc26b04/0xf646e0cda875dc21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708434:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135616.708438:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708445:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.708448:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708455:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708463:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.708469:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.708471:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.708472:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.708520:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.708581:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.708587:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c50632db/0xf646e0cda875dc28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135616.709155:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.709163:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.709185:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.709188:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.709194:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.709206:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.709225:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.709233:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.709695:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135616.709702:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.709711:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135616.709716:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.709739:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.709754:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135616.709764:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.709766:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135616.709767:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.710704:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.710713:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de57acc1/0xf646e0cda875dc2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135616.711382:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.711391:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.711404:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.711408:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.711414:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.711428:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.711437:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.711456:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.711714:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135616.711722:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.711731:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.711737:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.711747:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.711763:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.711779:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.711781:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.711782:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.711838:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.711844:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001764c049/0xf646e0cda875dc36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.711869:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.714410:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.714424:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.714440:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.714444:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.714450:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.714463:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.714550:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.714560:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.714590:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135616.715225:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.715234:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715245:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.715248:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.715252:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715264:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715271:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715278:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715295:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1783135616.715309:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783135616.715315:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715323:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135616.715334:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715343:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715362:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715369:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c9e0562e/0xf646e0cda875dc3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715391:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135616.715395:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715401:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135616.715404:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715412:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715422:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715429:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.715450:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.715452:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.715454:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.717535:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.717548:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717566:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.717571:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.717577:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717590:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717601:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717609:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717632:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783135616.717645:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783135616.717651:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717669:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135616.717674:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717683:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717702:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717710:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7594fae/0xf646e0cda875dc4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.717728:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.717730:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.717732:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.718364:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.719333:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.719344:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.719358:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.719362:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.719367:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.719379:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.719396:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.719404:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.719427:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135616.720093:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.720101:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.720111:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.720114:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.720118:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.720127:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.720135:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.720143:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.720178:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783135616.720617:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135616.720626:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720636:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39a00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.720641:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720650:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720667:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720674:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082c2a6db/0xf646e0cda875dc52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720693:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135616.720697:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720702:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.720712:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720719:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720730:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720737:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b45b8547/0xf646e0cda875dc59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.720751:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.720753:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.720754:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.721090:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.721097:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721105:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.721107:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.721111:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721121:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721128:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721135:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721196:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135616.721713:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.721719:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721728:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.721736:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.721741:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721750:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721758:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.721765:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783135616.722749:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1783135616.722894:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135616.723036:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723050:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.723055:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723066:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723085:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723105:0:14111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d2e9b387/0xf646e0cda875dc60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723125:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135616.723128:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723135:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.723137:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723144:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723154:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.723161:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.723162:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.723164:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135616.723582:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.723631:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.723638:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad3860c4/0xf646e0cda875dc67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.725032:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783135616.726389:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.726401:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.726420:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.726424:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.726430:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.726444:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.726460:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.726540:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.726605:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783135616.727081:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.727089:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.727098:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.727101:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.727105:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.727115:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.727122:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.727129:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727684:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783135616.727694:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727704:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39e00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.727719:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727729:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727749:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727757:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096b4812e/0xf646e0cda875dc6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727777:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135616.727781:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727788:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.727791:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727798:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727809:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.727842:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.727848:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.727850:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.728141:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.728148:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000faaa267c/0xf646e0cda875dc75 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135616.728794:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783135616.728801:0:14760:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.728840:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=516s v=(0 0) 00010000:00010000:3.0:1783135616.728857:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135616.728862:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.728884:0:14760:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.728893:0:14760:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135616.728899:0:14760:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.729732:0:14111:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783135616.729741:0:14111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.729753:0:14111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135616.729759:0:14111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.729769:0:14111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.729789:0:14111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135616.729798:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.729800:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135616.729802:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783135616.730079:0:14760:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783135616.730086:0:14760:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004946fde1/0xf646e0cda875dc7c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1783135616.730413:0:14760:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1783135616.730526:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14148:x1869752813327104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 93985us (94410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135616.730535:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135616.730701:0:14148:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14148:1869752813327104:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783135616.730720:0:14148:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:1.0:1783135616.730767:0:14148:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14148:1869752813327232:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783135616.730806:0:14148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135616.730900:0:14148:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200540 going to sleep for 11 seconds 00000100:00100000:3.0:1783135616.731101:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813327232 00000100:00100000:3.0:1783135616.731107:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813327232 00000100:00100000:3.0:1783135616.731154:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783135616.731163:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14148:x1869752813327232:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783135616.731209:0:14761:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1783135616.735182:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135616.742076:0:14148:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14148:1869752813327232:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783135616.742096:0:14148:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1783135616.742147:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14148:x1869752813327232:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10712us (11069us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783135616.742159:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1783135617.215467:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783135617.553517:0:15784:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg160-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783135617.658559:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135617.658582:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813327360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135617.658647:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135617.658707:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813327360 00000100:00100000:2.0:1783135617.658713:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813327360 00000100:00100000:2.0:1783135617.658762:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783135617.658769:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813327360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783135617.658805:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135617.658875:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813327360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135617.658882:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783135617.658951:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813327360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783135618.238733:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135619.258013:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135620.197634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135620.197809:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792359680 00000100:00100000:3.0:1783135620.197910:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792359680 00000100:00100000:3.0:1783135620.198019:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 74 00000100:00100000:3.0:1783135620.198029:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2359:x1869752792359680:12345-192.168.201.60@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783135620.198063:0:14116:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 6f021332-5796-4bf3-99ee-d085123cca02@192.168.201.60@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:3.0:1783135620.198098:0:14116:0:(genops.c:1406:class_connect()) connect: client 6f021332-5796-4bf3-99ee-d085123cca02, cookie 0xf646e0cda875dc83 00000100:00080000:3.0:1783135620.198284:0:14116:0:(import.c:65:import_set_state_nolock()) ffff8e8f3cd52800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135620.198426:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd21850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+5:2359:x1869752792359680:12345-192.168.201.60@tcp:250:mount.lustre.0 Request processed in 397us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135620.198434:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 74 00000100:00100000:2.0:1783135620.202146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135620.202228:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792359808 00000100:00100000:1.0:1783135620.202241:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792359808 00000100:00100000:1.0:1783135620.202300:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 75 00000100:00100000:1.0:1783135620.202311:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+5:13697:x1869752792359808:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135620.202332:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135620.202363:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121ce00/0xf646e0cda875dc8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab121b2 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135620.202395:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121ce00/0xf646e0cda875dc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121b2 expref: 6 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135620.202405:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121ce00/0xf646e0cda875dc8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121b2 expref: 6 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135620.202413:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121ce00, rc 0) 00000100:00100000:1.0:1783135620.202465:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd21050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+6:13697:x1869752792359808:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 158us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135620.202470:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 75 00000100:00100000:0.0:1783135620.206057:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135620.208191:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792359936 00000100:00100000:3.0:1783135620.208304:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792359936 00000100:00100000:3.0:1783135620.208382:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 76 00000100:00100000:3.0:1783135620.208407:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+6:13697:x1869752792359936:12345-192.168.201.60@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783135620.208715:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd22450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+6:13697:x1869752792359936:12345-192.168.201.60@tcp:501:mount.lustre.0 Request processed in 307us (2667us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783135620.208723:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 76 00000100:00100000:0.0:1783135620.224981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135620.227158:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792360064 00000100:00100000:1.0:1783135620.227174:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792360064 00000100:00100000:1.0:1783135620.227361:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 77 00000100:00100000:1.0:1783135620.227372:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+6:13697:x1869752792360064:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135620.227390:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135620.227476:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121ca00/0xf646e0cda875dc91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab121b9 expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135620.227507:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121ca00/0xf646e0cda875dc91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121b9 expref: 7 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135620.227517:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121ca00/0xf646e0cda875dc91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121b9 expref: 7 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135620.227525:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121ca00, rc 0) 00000100:00100000:1.0:1783135620.227595:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd20c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+7:13697:x1869752792360064:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 225us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135620.227615:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 77 00000100:00100000:0.0:1783135620.238432:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135620.238726:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792360192 00000100:00100000:3.0:1783135620.238741:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792360192 00000100:00100000:3.0:1783135620.238859:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 78 00000100:00100000:3.0:1783135620.238875:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+7:13697:x1869752792360192:12345-192.168.201.60@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783135620.240008:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd20450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+8:13697:x1869752792360192:12345-192.168.201.60@tcp:501:mount.lustre.0 Request processed in 1125us (1595us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135620.240032:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 78 00000100:00100000:0.0:1783135620.247383:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135620.249126:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792360320 00000100:00100000:1.0:1783135620.249155:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792360320 00000100:00100000:1.0:1783135620.249256:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:1.0:1783135620.249270:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+8:13697:x1869752792360320:12345-192.168.201.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783135620.249997:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd21c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+8:13697:x1869752792360320:12345-192.168.201.60@tcp:503:mount.lustre.0 Request processed in 724us (2626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135620.250009:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 79 00000100:00100000:1.0:1783135620.261235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135620.262074:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792360448 00000100:00100000:0.0:1783135620.262090:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792360448 00000100:00100000:0.0:1783135620.262274:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 80 00000100:00100000:0.0:1783135620.262288:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+8:13716:x1869752792360448:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135620.263054:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd22850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+8:13716:x1869752792360448:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 761us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135620.263065:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 80 00010000:00010000:0.0:1783135620.285380:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783135620.293291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135620.293465:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792360576 00000100:00100000:1.0:1783135620.293480:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792360576 00000100:00100000:1.0:1783135620.293557:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 81 00000100:00100000:1.0:1783135620.293569:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+8:13716:x1869752792360576:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135620.295665:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd26450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+8:13716:x1869752792360576:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 630us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135620.295694:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 81 00000100:00100000:3.0:1783135620.304945:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135620.305019:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792360704 00000100:00100000:0.0:1783135620.305034:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792360704 00000100:00100000:0.0:1783135620.305117:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 82 00000100:00100000:0.0:1783135620.305130:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+8:13697:x1869752792360704:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783135620.305159:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135620.305184:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3d042000/0xf646e0cda875dc98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab121e3 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.305221:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3d042000/0xf646e0cda875dc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121e3 expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.305232:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3d042000/0xf646e0cda875dc98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121e3 expref: 9 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.305242:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042000, rc 0) 00000100:00100000:0.0:1783135620.305367:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd24c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+9:13697:x1869752792360704:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 239us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135620.305376:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 82 00000100:00100000:0.0:1783135620.311208:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135620.311487:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792360832 00000100:00100000:1.0:1783135620.311503:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792360832 00000100:00100000:1.0:1783135620.311577:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 83 00000100:00100000:1.0:1783135620.311589:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+9:13697:x1869752792360832:12345-192.168.201.60@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783135620.311644:0:14117:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783135620.311681:0:14117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783135620.311686:0:14117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783135620.311690:0:14117:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783135620.311693:0:14117:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783135620.314658:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd24450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+9:13697:x1869752792360832:12345-192.168.201.60@tcp:256:mount.lustre.0 Request processed in 3052us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135620.314680:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 83 00000100:00100000:0.0:1783135620.320947:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135620.321034:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792360960 00000100:00100000:2.0:1783135620.321046:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792360960 00000100:00100000:2.0:1783135620.321129:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00100000:2.0:1783135620.321141:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+9:13697:x1869752792360960:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135620.321178:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135620.321203:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab121ea expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135620.321237:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 10 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135620.321247:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 10 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135620.321276:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3a00, rc 0) 00000100:00100000:2.0:1783135620.321342:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd25c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+10:13697:x1869752792360960:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 202us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135620.321350:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 84 00000100:00100000:0.0:1783135620.325721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135620.326067:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792361088 00000100:00100000:2.0:1783135620.326088:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792361088 00000100:00100000:2.0:1783135620.326178:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 85 00000100:00100000:2.0:1783135620.326192:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+10:13697:x1869752792361088:12345-192.168.201.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135620.329577:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd26850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+10:13697:x1869752792361088:12345-192.168.201.60@tcp:501:mount.lustre.0 Request processed in 417us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135620.329615:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 85 00000100:00100000:1.0:1783135620.334678:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135620.338843:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792361216 00000100:00100000:2.0:1783135620.338865:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792361216 00000100:00100000:2.0:1783135620.338956:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 86 00000100:00100000:2.0:1783135620.338968:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+10:13697:x1869752792361216:12345-192.168.201.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783135620.339320:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd26c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+10:13697:x1869752792361216:12345-192.168.201.60@tcp:503:mount.lustre.0 Request processed in 353us (4659us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135620.339330:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 86 00000100:00100000:3.0:1783135620.347276:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135620.347397:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792361344 00000100:00100000:2.0:1783135620.347411:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792361344 00000100:00100000:2.0:1783135620.347499:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 87 00000100:00100000:2.0:1783135620.347512:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+10:13719:x1869752792361344:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135620.348557:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd26050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+10:13719:x1869752792361344:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 1040us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135620.348582:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 87 00000100:00100000:1.0:1783135620.370499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135620.370964:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792361472 00000100:00100000:3.0:1783135620.370979:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792361472 00000100:00100000:3.0:1783135620.371047:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 88 00000100:00100000:3.0:1783135620.371060:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+10:13719:x1869752792361472:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783135620.371418:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd27450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+10:13719:x1869752792361472:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 360us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135620.371429:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 88 00000100:00100000:1.0:1783135620.385887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135620.386021:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792361600 00000100:00100000:2.0:1783135620.386036:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792361600 00000100:00100000:2.0:1783135620.386092:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:2.0:1783135620.386103:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1869752792361600:12345-192.168.201.60@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783135620.386150:0:14123:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from ceb6e8e3-b75e-4201-a568-34429b542814@192.168.201.60@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1783135620.386222:0:14123:0:(genops.c:1406:class_connect()) connect: client ceb6e8e3-b75e-4201-a568-34429b542814, cookie 0xf646e0cda875dca6 00000004:00100000:2.0:1783135620.386269:0:14123:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1783135620.386276:0:14123:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1783135620.468215:0:14123:0:(import.c:65:import_set_state_nolock()) ffff8e8f3cd56800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783135620.468313:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:2359:x1869752792361600:12345-192.168.201.60@tcp:38:mount.lustre.0 Request processed in 82209us (82497us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135620.468329:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:2.0:1783135620.472518:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135620.472649:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792361856 00000100:00100000:0.0:1783135620.472659:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792361856 00000100:00100000:0.0:1783135620.472740:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:0.0:1783135620.472753:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+6:13697:x1869752792361856:12345-192.168.201.60@tcp:41:mount.lustre.0 00000004:00000024:0.0:1783135620.472804:0:14124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783135620.472938:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+6:13697:x1869752792361856:12345-192.168.201.60@tcp:41:mount.lustre.0 Request processed in 187us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135620.472946:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:3.0:1783135620.473189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135620.473337:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792361728 00000100:00100000:1.0:1783135620.473343:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792361728 00000100:00100000:1.0:1783135620.473370:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:1.0:1783135620.473377:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+6:0:x1869752792361728:12345-192.168.201.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135620.473393:0:14125:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783135620.473440:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+6:0:x1869752792361728:12345-192.168.201.60@tcp:41:mount.lustre.0 Request processed in 63us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135620.473447:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00080000:2.0:1783135620.473607:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783135620.475284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135620.475357:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792361984 00000100:00100000:0.0:1783135620.475365:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792361984 00000100:00100000:0.0:1783135620.475425:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:0.0:1783135620.475435:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:13697:x1869752792361984:12345-192.168.201.60@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783135620.475519:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:13697:x1869752792361984:12345-192.168.201.60@tcp:40:mount.lustre.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135620.475527:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:3.0:1783135620.477968:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135620.478020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135620.478148:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792362112 00000100:00100000:2.0:1783135620.478158:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792362112 00000100:00100000:2.0:1783135620.478208:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792362240 00000100:00100000:2.0:1783135620.478212:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792362240 00000100:00100000:2.0:1783135620.478311:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:2.0:1783135620.478319:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1869752792362112:12345-192.168.201.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783135620.478353:0:14760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ceb6e8e3-b75e-4201-a568-34429b542814@192.168.201.60@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1783135620.478385:0:14760:0:(genops.c:1406:class_connect()) connect: client ceb6e8e3-b75e-4201-a568-34429b542814, cookie 0xf646e0cda875dcad 00002000:00100000:2.0:1783135620.478397:0:14760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ceb6e8e3-b75e-4201-a568-34429b542814/ffff8e8f3d515800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783135620.478435:0:14760:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783135620.478783:0:14760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783135620.478813:0:14760:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d516800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135620.478927:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:2359:x1869752792362112:12345-192.168.201.60@tcp:8:mount.lustre.0 Request processed in 607us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135620.478948:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:2.0:1783135620.478968:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:2.0:1783135620.478974:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1869752792362240:12345-192.168.201.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783135620.478992:0:14760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ceb6e8e3-b75e-4201-a568-34429b542814@192.168.201.60@tcp t0 exp 0000000000000000 cur 519 last 0 00000020:00000080:2.0:1783135620.479009:0:14760:0:(genops.c:1406:class_connect()) connect: client ceb6e8e3-b75e-4201-a568-34429b542814, cookie 0xf646e0cda875dcb4 00002000:00100000:2.0:1783135620.479015:0:14760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ceb6e8e3-b75e-4201-a568-34429b542814/ffff8e8f3d513800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783135620.479029:0:14760:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783135620.479165:0:14760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783135620.479182:0:14760:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d512800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783135620.479208:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:2359:x1869752792362240:12345-192.168.201.60@tcp:8:mount.lustre.0 Request processed in 232us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135620.479216:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:3.0:1783135620.479891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135620.484286:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792362368 00000100:00100000:1.0:1783135620.484300:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792362368 00000100:00100000:1.0:1783135620.484364:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:1.0:1783135620.484374:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:13697:x1869752792362368:12345-192.168.201.60@tcp:33:mount.lustre.0 00000004:00080000:1.0:1783135620.485922:0:14126:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1414us 00000004:00200000:3.0:1783135620.507176:0:14126:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783135620.507385:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:13697:x1869752792362368:12345-192.168.201.60@tcp:33:mount.lustre.0 Request processed in 23006us (27492us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135620.507399:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:3.0:1783135620.727171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135620.727303:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792362496 00000100:00100000:0.0:1783135620.727314:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792362496 00000100:00100000:0.0:1783135620.727379:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:0.0:1783135620.727390:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+6:13740:x1869752792362496:12345-192.168.201.60@tcp:101:mkdir.0 00010000:00010000:0.0:1783135620.727420:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135620.727459:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dcbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12214 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.727543:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875dcc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.727559:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875dcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.727573:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875dcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135620.727797:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783135620.727801:0:14124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135620.727919:0:14124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875dcc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.727946:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dcbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12214 expref: 8 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.727964:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875dcc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12214 expref: 7 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135620.727972:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:0.0:1783135620.727976:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135620.727979:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042200, rc 0) 00000100:00100000:0.0:1783135620.728056:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+7:13740:x1869752792362496:12345-192.168.201.60@tcp:101:mkdir.0 Request processed in 667us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135620.728064:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00010000:00010000:1.0:1783135621.307540:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135621.754453:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813327488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135621.754523:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135621.754601:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813327488 00000100:00100000:2.0:1783135621.754609:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813327488 00000100:00100000:2.0:1783135621.754664:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135621.754674:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869752813327488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135621.754712:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135621.754783:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3314:x1869752813327488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135621.754791:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1783135621.754836:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783135621.754868:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813327488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135621.755024:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813328000:0@lo:400:kworker.0 00000100:00100000:1.0:1783135621.755056:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135621.755096:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783135621.755102:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813327872:0@lo:400:kworker.0 00000100:00100000:1.0:1783135621.755126:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135621.755152:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813328000 00000100:00100000:1.0:1783135621.755155:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813328000 00000100:00100000:1.0:1783135621.755189:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813327872 00000100:00100000:1.0:1783135621.755193:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813327872 00000100:00100000:1.0:1783135621.755207:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135621.755221:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813328000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135621.755261:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813328000:12345-0@lo:400:kworker.0 Request processed in 41us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135621.755268:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783135621.755282:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783135621.755287:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813327872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135621.755313:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3314:x1869752813327872:12345-0@lo:400:kworker.0 Request processed in 26us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135621.755318:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1783135621.755332:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135621.755348:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3314:1869752813327872:0@lo:400:kworker.0 00000100:00100000:1.0:1783135621.755358:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813328000:0@lo:400:kworker.0 00000100:00100000:2.0:1783135621.756448:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3311:1869752813327616:0@lo:400:kworker.0 00000100:00100000:2.0:1783135621.756490:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135621.756526:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813328128:0@lo:400:kworker.0 00000100:00100000:2.0:1783135621.756547:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135621.756574:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783135621.756579:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813327744:0@lo:400:kworker.0 00000100:00100000:2.0:1783135621.756602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135621.756671:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813328128 00000100:00100000:0.0:1783135621.756685:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813328128 00000100:00100000:0.0:1783135621.756729:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783135621.756736:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813328128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783135621.756775:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813328128:12345-0@lo:400:kworker.0 Request processed in 39us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135621.756781:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783135621.758184:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813327616 00000100:00100000:3.0:1783135621.758193:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813327616 00000100:00100000:3.0:1783135621.758240:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1783135621.758251:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3311:x1869752813327616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135621.758307:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd24850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3311:x1869752813327616:12345-0@lo:400:kworker.0 Request processed in 59us (1815us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135621.758314:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:2.0:1783135621.758417:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135621.758447:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3311:1869752813327616:0@lo:400:kworker.0 00000100:00100000:2.0:1783135621.758480:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813328128:0@lo:400:kworker.0 00000100:00100000:2.0:1783135621.758541:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813327744 00000100:00100000:2.0:1783135621.758545:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813327744 00000100:00100000:2.0:1783135621.758592:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783135621.758601:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813327744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135621.758647:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813327744:12345-0@lo:400:kworker.0 Request processed in 47us (2043us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135621.758655:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783135621.758678:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135621.758695:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03333800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813327744:0@lo:400:kworker.0 00000001:00100000:2.0:1783135621.825275:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ceb6e8e3-b75e-4201-a568-34429b542814 00000001:00100000:2.0:1783135621.825293:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783135621.825303:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1783135622.332104:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135622.654291:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135622.654415:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792362624 00000100:00100000:0.0:1783135622.654427:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792362624 00000100:00100000:0.0:1783135622.654530:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:0.0:1783135622.654541:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+7:13792:x1869752792362624:12345-192.168.201.60@tcp:41:lfs.0 00000004:00000024:0.0:1783135622.654590:0:14124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1783135622.654678:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+7:13792:x1869752792362624:12345-192.168.201.60@tcp:41:lfs.0 Request processed in 138us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135622.654686:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00080000:2.0:1783135622.654881:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135622.662538:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135622.669877:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792362752 00000100:00100000:2.0:1783135622.669894:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792362752 00000100:00080000:0.0:1783135622.670060:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783135622.670213:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:2.0:1783135622.670225:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ceb6e8e3-b75e-4201-a568-34429b542814+6:13792:x1869752792362752:12345-192.168.201.60@tcp:13:lfs.0 00002000:00000024:2.0:1783135622.670265:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135622.670372:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ceb6e8e3-b75e-4201-a568-34429b542814+6:13792:x1869752792362752:12345-192.168.201.60@tcp:13:lfs.0 Request processed in 141us (7838us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135622.670380:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:0.0:1783135622.677656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135622.678092:0:14764:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792362880 00000100:00100000:3.0:1783135622.678104:0:14764:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792362880 00000100:00100000:3.0:1783135622.678392:0:14764:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:3.0:1783135622.678404:0:14764:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ceb6e8e3-b75e-4201-a568-34429b542814+5:13792:x1869752792362880:12345-192.168.201.60@tcp:13:lfs.0 00002000:00000024:3.0:1783135622.678435:0:14764:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783135622.678528:0:14764:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ceb6e8e3-b75e-4201-a568-34429b542814+5:13792:x1869752792362880:12345-192.168.201.60@tcp:13:lfs.0 Request processed in 127us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135622.678535:0:14764:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00080000:0.0:1783135622.679116:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135622.778162:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783135622.778187:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813328256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135622.778258:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135622.778454:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813328256 00000100:00100000:0.0:1783135622.778463:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813328256 00000100:00100000:0.0:1783135622.778512:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783135622.778522:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813328256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135622.778548:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135622.778598:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813328256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135622.778606:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783135622.778850:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03330e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813328256:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1783135622.830001:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ceb6e8e3-b75e-4201-a568-34429b542814 00000100:00100000:0.0:1783135622.900850:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135622.900922:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792363008 00000100:00100000:1.0:1783135622.900931:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792363008 00000100:00100000:1.0:1783135622.900987:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 90 00000100:00100000:1.0:1783135622.900998:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+10:13824:x1869752792363008:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135622.901012:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135622.901028:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121d800/0xf646e0cda875dcc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1221b expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135622.901051:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121d800/0xf646e0cda875dcc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1221b expref: 11 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135622.901091:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121d800/0xf646e0cda875dcc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1221b expref: 11 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135622.901120:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d800, rc 0) 00000100:00100000:1.0:1783135622.901186:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd25450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+11:13824:x1869752792363008:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 190us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135622.901193:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 90 00000100:00100000:1.0:1783135622.905179:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135622.905280:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792363136 00000100:00100000:2.0:1783135622.905290:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792363136 00000100:00100000:2.0:1783135622.905349:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 91 00000100:00100000:2.0:1783135622.905360:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+11:13824:x1869752792363136:12345-192.168.201.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135622.905681:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd27050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+11:13824:x1869752792363136:12345-192.168.201.60@tcp:501:mount.lustre.0 Request processed in 322us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135622.905690:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 91 00000100:00100000:0.0:1783135622.911301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135622.911497:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792363264 00000100:00100000:3.0:1783135622.911507:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792363264 00000100:00100000:3.0:1783135622.911595:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 92 00000100:00100000:3.0:1783135622.911605:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+11:13824:x1869752792363264:12345-192.168.201.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783135622.913991:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd27c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+11:13824:x1869752792363264:12345-192.168.201.60@tcp:503:mount.lustre.0 Request processed in 2377us (2690us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135622.914015:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 92 00000100:00100000:0.0:1783135622.928686:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135622.929124:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792363392 00000100:00100000:1.0:1783135622.929137:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792363392 00000100:00100000:1.0:1783135622.929317:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 93 00000100:00100000:1.0:1783135622.929329:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+11:13831:x1869752792363392:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783135622.929994:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd27850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+11:13831:x1869752792363392:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 318us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135622.930006:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 93 00000100:00100000:1.0:1783135622.954940:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135622.955044:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792363520 00000100:00100000:2.0:1783135622.955054:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792363520 00000100:00100000:2.0:1783135622.955124:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 94 00000100:00100000:2.0:1783135622.955133:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+11:13831:x1869752792363520:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135622.955434:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd24050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+11:13831:x1869752792363520:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 300us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135622.955443:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 94 00000100:00100000:0.0:1783135622.972429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135622.974093:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792363648 00000100:00100000:1.0:1783135622.974112:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792363648 00000100:00100000:1.0:1783135622.974212:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 95 00000100:00100000:1.0:1783135622.974226:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+11:13824:x1869752792363648:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783135622.974249:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135622.974273:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121c400/0xf646e0cda875dcd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12245 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135622.974315:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121c400/0xf646e0cda875dcd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12245 expref: 12 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135622.974328:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121c400/0xf646e0cda875dcd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12245 expref: 12 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135622.974353:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c400, rc 0) 00000100:00100000:1.0:1783135622.974431:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd25850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+12:13824:x1869752792363648:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 208us (2013us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135622.974438:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 95 00000100:00100000:0.0:1783135622.979570:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135622.979857:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792363776 00000100:00100000:3.0:1783135622.979868:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792363776 00000100:00100000:3.0:1783135622.979934:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 96 00000100:00100000:3.0:1783135622.979944:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+12:13824:x1869752792363776:12345-192.168.201.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783135622.979970:0:14116:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783135622.979996:0:14116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783135622.980000:0:14116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783135622.980003:0:14116:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783135622.980006:0:14116:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783135622.989682:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+12:13824:x1869752792363776:12345-192.168.201.60@tcp:256:mount.lustre.0 Request processed in 9726us (10112us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135622.989712:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 96 00000100:00100000:0.0:1783135622.997887:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135622.998307:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792363904 00000100:00100000:2.0:1783135622.998318:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792363904 00000100:00100000:2.0:1783135622.998385:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 97 00000100:00100000:2.0:1783135622.998396:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+12:13824:x1869752792363904:12345-192.168.201.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783135622.998415:0:14117:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135622.998435:0:14117:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1224c expref: -99 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135622.998463:0:14117:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 13 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135622.998475:0:14117:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 13 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135622.998485:0:14117:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2200, rc 0) 00000100:00100000:2.0:1783135622.998559:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:13824:x1869752792363904:12345-192.168.201.60@tcp:101:mount.lustre.0 Request processed in 164us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135622.998567:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 97 00000100:00100000:0.0:1783135623.001859:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135623.002000:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792364032 00000100:00100000:2.0:1783135623.002012:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792364032 00000100:00100000:2.0:1783135623.002110:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 98 00000100:00100000:2.0:1783135623.002121:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+13:13824:x1869752792364032:12345-192.168.201.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783135623.002457:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+13:13824:x1869752792364032:12345-192.168.201.60@tcp:501:mount.lustre.0 Request processed in 337us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135623.002466:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 98 00000100:00100000:3.0:1783135623.005685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135623.005856:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792364160 00000100:00100000:1.0:1783135623.005866:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792364160 00000100:00100000:1.0:1783135623.005925:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 99 00000100:00100000:1.0:1783135623.005936:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+13:13824:x1869752792364160:12345-192.168.201.60@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783135623.006212:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a39c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+13:13824:x1869752792364160:12345-192.168.201.60@tcp:503:mount.lustre.0 Request processed in 277us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135623.006221:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 99 00000100:00100000:3.0:1783135623.010306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135623.010991:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792364288 00000100:00100000:0.0:1783135623.011002:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792364288 00000100:00100000:0.0:1783135623.011081:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 100 00000100:00100000:0.0:1783135623.011093:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:13835:x1869752792364288:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783135623.011536:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a38450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:13835:x1869752792364288:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 443us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135623.011546:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 100 00000100:00100000:0.0:1783135623.024188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135623.024340:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792364416 00000100:00100000:2.0:1783135623.024350:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792364416 00000100:00100000:2.0:1783135623.024413:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 101 00000100:00100000:2.0:1783135623.024422:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+13:13835:x1869752792364416:12345-192.168.201.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783135623.024708:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a38c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+13:13835:x1869752792364416:12345-192.168.201.60@tcp:502:llog_process_th.0 Request processed in 285us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135623.024717:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 101 00000100:00100000:3.0:1783135623.042650:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135623.042714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135623.042746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135623.042770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135623.042795:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792365184 00000100:00100000:3.0:1783135623.042803:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792365184 00000100:00100000:3.0:1783135623.042872:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792365056 00000100:00100000:3.0:1783135623.042876:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792365056 00000100:00100000:3.0:1783135623.042896:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:3.0:1783135623.042905:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+5:2362:x1869752792365184:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135623.042974:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+5:2362:x1869752792365184:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135623.042982:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:3.0:1783135623.042997:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:3.0:1783135623.043017:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+5:2362:x1869752792365056:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135623.043041:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+5:2362:x1869752792365056:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 26us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135623.043047:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:1.0:1783135623.043467:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792364544 00000100:00100000:1.0:1783135623.043472:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792364544 00000100:00100000:1.0:1783135623.043496:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792364928 00000100:00100000:1.0:1783135623.043498:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792364928 00000100:00100000:1.0:1783135623.043518:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:1.0:1783135623.043524:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+7:2362:x1869752792364928:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135623.043564:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+7:2362:x1869752792364928:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 40us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135623.043571:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:1.0:1783135623.043585:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:1.0:1783135623.043589:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2359:x1869752792364544:12345-192.168.201.60@tcp:38:mount.lustre.0 00010000:00080000:1.0:1783135623.043611:0:14124:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from a2ce35c1-9280-4944-a51c-87d3518837f6@192.168.201.60@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:1.0:1783135623.043654:0:14124:0:(genops.c:1406:class_connect()) connect: client a2ce35c1-9280-4944-a51c-87d3518837f6, cookie 0xf646e0cda875dcde 00000004:00100000:1.0:1783135623.043694:0:14124:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1783135623.043852:0:14124:0:(import.c:65:import_set_state_nolock()) ffff8e8e02eba800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783135623.043885:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2359:x1869752792364544:12345-192.168.201.60@tcp:38:mount.lustre.0 Request processed in 293us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135623.043891:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:3.0:1783135623.049462:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135623.049628:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792364672 00000100:00100000:1.0:1783135623.049638:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792364672 00000100:00100000:1.0:1783135623.049726:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:1.0:1783135623.049736:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+6:0:x1869752792364672:12345-192.168.201.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1783135623.049771:0:14124:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1783135623.049878:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+6:0:x1869752792364672:12345-192.168.201.60@tcp:41:mount.lustre.0 Request processed in 143us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135623.049886:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00080000:0.0:1783135623.049966:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135623.054453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135623.054621:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792364800 00000100:00100000:2.0:1783135623.054631:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792364800 00000100:00100000:2.0:1783135623.054695:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:2.0:1783135623.054706:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+6:13824:x1869752792364800:12345-192.168.201.60@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783135623.054739:0:14123:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783135623.056165:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+6:13824:x1869752792364800:12345-192.168.201.60@tcp:41:mount.lustre.0 Request processed in 113us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135623.056178:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:3.0:1783135623.056869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135623.057111:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792365312 00000100:00100000:1.0:1783135623.057122:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792365312 00000100:00100000:1.0:1783135623.057195:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:1.0:1783135623.057207:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+6:13824:x1869752792365312:12345-192.168.201.60@tcp:40:mount.lustre.0 00000100:00100000:1.0:1783135623.057352:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+6:13824:x1869752792365312:12345-192.168.201.60@tcp:40:mount.lustre.0 Request processed in 147us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135623.057368:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:1.0:1783135623.066244:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135623.066284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135623.066558:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792365696 00000100:00100000:3.0:1783135623.066569:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792365696 00000100:00100000:3.0:1783135623.066632:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:3.0:1783135623.066643:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+6:13824:x1869752792365696:12345-192.168.201.60@tcp:33:mount.lustre.0 00000004:00200000:3.0:1783135623.066914:0:14127:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1783135623.067074:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+6:13824:x1869752792365696:12345-192.168.201.60@tcp:33:mount.lustre.0 Request processed in 420us (826us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135623.067083:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:1.0:1783135623.067770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135623.083594:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792365440 00000100:00100000:2.0:1783135623.083610:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792365440 00000100:00100000:2.0:1783135623.083672:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792365568 00000100:00100000:2.0:1783135623.083675:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792365568 00000100:00100000:2.0:1783135623.083711:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:2.0:1783135623.083719:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1869752792365440:12345-192.168.201.60@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783135623.083752:0:14760:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from a2ce35c1-9280-4944-a51c-87d3518837f6@192.168.201.60@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:2.0:1783135623.083787:0:14760:0:(genops.c:1406:class_connect()) connect: client a2ce35c1-9280-4944-a51c-87d3518837f6, cookie 0xf646e0cda875dce5 00002000:00100000:2.0:1783135623.083799:0:14760:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a2ce35c1-9280-4944-a51c-87d3518837f6/ffff8e8f3d517000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783135623.083811:0:14760:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783135623.084130:0:14760:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:0.0:1783135623.087335:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:0.0:1783135623.087351:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1869752792365568:12345-192.168.201.60@tcp:8:mount.lustre.0 00010000:00080000:0.0:1783135623.087412:0:14762:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from a2ce35c1-9280-4944-a51c-87d3518837f6@192.168.201.60@tcp t0 exp 0000000000000000 cur 522 last 0 00000020:00000080:0.0:1783135623.087451:0:14762:0:(genops.c:1406:class_connect()) connect: client a2ce35c1-9280-4944-a51c-87d3518837f6, cookie 0xf646e0cda875dcec 00002000:00100000:0.0:1783135623.087466:0:14762:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a2ce35c1-9280-4944-a51c-87d3518837f6/ffff8e8f3c6f2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113654 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783135623.087481:0:14762:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783135623.087760:0:14762:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783135623.094348:0:14760:0:(import.c:65:import_set_state_nolock()) ffff8e8f3d510800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1783135623.098225:0:14762:0:(import.c:65:import_set_state_nolock()) ffff8e8f3fd4b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783135623.098323:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2359:x1869752792365568:12345-192.168.201.60@tcp:8:mount.lustre.0 Request processed in 10968us (30552us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135623.098350:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:2.0:1783135623.102565:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2359:x1869752792365440:12345-192.168.201.60@tcp:8:mount.lustre.0 Request processed in 18831us (36266us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135623.102582:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00010000:00010000:1.0:1783135623.356635:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135623.372599:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135623.372723:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792365824 00000100:00100000:0.0:1783135623.372733:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792365824 00000100:00100000:0.0:1783135623.372802:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:0.0:1783135623.372810:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+6:13856:x1869752792365824:12345-192.168.201.60@tcp:101:mkdir.0 00010000:00010000:0.0:1783135623.372855:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135623.372877:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dcf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12276 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135623.372945:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135623.372959:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135623.372970:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135623.373201:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783135623.373206:0:14124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135623.373286:0:14124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135623.373317:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dcf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 8 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135623.373337:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 7 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135623.373358:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:0.0:1783135623.373361:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135623.373365:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043800, rc 0) 00000100:00100000:0.0:1783135623.373436:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+7:13856:x1869752792365824:12345-192.168.201.60@tcp:101:mkdir.0 Request processed in 625us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135623.373444:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 14 00010000:00010000:2.0:1783135624.377992:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135624.892390:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783135625.402159:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783135625.910912:0:5817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a2ce35c1-9280-4944-a51c-87d3518837f6 00000001:00100000:0.0:1783135625.910937:0:5817:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ceb6e8e3-b75e-4201-a568-34429b542814 00010000:00010000:3.0:1783135626.426333:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783135626.465730:0:15988:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1783135626.875875:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813328512:0@lo:400:kworker.0 00000100:00100000:2.0:1783135626.875990:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135626.876071:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1869752813329024:0@lo:400:kworker.0 00000100:00100000:2.0:1783135626.876103:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135626.876132:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783135626.876138:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3314:1869752813328384:0@lo:400:kworker.0 00000100:00100000:2.0:1783135626.876172:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135626.876408:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813328768:0@lo:400:kworker.0 00000100:00100000:1.0:1783135626.876454:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135626.876474:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783135626.876480:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813328640:0@lo:400:kworker.0 00000100:00100000:1.0:1783135626.876505:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135626.876539:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813329152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783135626.876565:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135626.876614:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813329024 00000100:00100000:1.0:1783135626.876623:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813329024 00000100:00100000:1.0:1783135626.876686:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813328768 00000100:00100000:1.0:1783135626.876689:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813328768 00000100:00100000:1.0:1783135626.876710:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135626.876721:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869752813329024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135626.876780:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3314:x1869752813329024:12345-0@lo:400:kworker.0 Request processed in 60us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135626.876788:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783135626.876807:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135626.876843:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813328768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135626.876877:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869752813328768:12345-0@lo:400:kworker.0 Request processed in 63us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135626.876884:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783135626.876903:0:15725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813328512 00000100:00100000:1.0:1783135626.876907:0:15725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813328512 00000100:00100000:1.0:1783135626.876933:0:15725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813328640 00000100:00100000:1.0:1783135626.876936:0:15725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813328640 00000100:00100000:1.0:1783135626.876975:0:15725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135626.877013:0:15725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813328512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135626.877048:0:15725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813328512:12345-0@lo:400:kworker.0 Request processed in 37us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135626.877054:0:15725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783135626.877065:0:15725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135626.877071:0:15725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813328640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135626.877097:0:15725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813328640:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135626.877102:0:15725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783135626.877140:0:3312:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1783135626.877162:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813328640:0@lo:400:kworker.0 00000100:00100000:1.0:1783135626.877175:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869752813328768:0@lo:400:kworker.0 00000100:00100000:0.0:1783135626.877584:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813329152 00000100:00100000:0.0:1783135626.877592:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813329152 00000100:00100000:0.0:1783135626.877628:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783135626.877635:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813329152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135626.877673:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135626.877845:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813329152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 210us (1279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135626.877853:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1783135626.877872:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783135626.877877:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135626.877881:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135626.881728:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813329152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135626.882215:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813328896:0@lo:400:kworker.0 00000100:00100000:2.0:1783135626.882287:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135626.882320:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813328896 00000100:00100000:2.0:1783135626.882327:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813328896 00000100:00100000:2.0:1783135626.882395:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135626.882405:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813328896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135626.882476:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3314:x1869752813328896:12345-0@lo:400:kworker.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135626.882484:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783135626.882520:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3314:1869752813328896:0@lo:400:kworker.0 00000100:00100000:2.0:1783135626.882536:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813328512:0@lo:400:kworker.0 00000100:00100000:2.0:1783135626.882550:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3314:1869752813329024:0@lo:400:kworker.0 00000100:00080000:0.0:1783135626.882691:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783135626.883999:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813328384 00000100:00100000:1.0:1783135626.884017:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813328384 00000100:00100000:1.0:1783135626.884088:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783135626.884103:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3314:x1869752813328384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135626.884438:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3314:x1869752813328384:12345-0@lo:400:kworker.0 Request processed in 338us (8262us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135626.884448:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783135626.886891:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3314:1869752813328384:0@lo:400:kworker.0 00000001:00100000:3.0:1783135626.962959:0:7494:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a2ce35c1-9280-4944-a51c-87d3518837f6 00010000:00010000:1.0:1783135627.456899:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135627.898045:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783135627.898068:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813329280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783135627.898143:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135627.912223:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813329280 00000100:00100000:1.0:1783135627.912247:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813329280 00000100:00100000:1.0:1783135627.912321:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135627.912332:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813329280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135627.912372:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783135627.912456:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813329280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (14314us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135627.912463:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783135627.912516:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813329280:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1783135627.976142:0:6616:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a2ce35c1-9280-4944-a51c-87d3518837f6 00000100:00100000:3.0:1783135628.279347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135628.279402:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135628.279433:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135628.279460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135628.279471:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135628.279489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135628.279512:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792366336 00000100:00100000:3.0:1783135628.279519:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792366336 00000100:00100000:3.0:1783135628.279559:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792366592 00000100:00100000:3.0:1783135628.279561:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792366592 00000100:00100000:2.0:1783135628.279586:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792366208 00000100:00100000:3.0:1783135628.279592:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:2.0:1783135628.279593:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792366208 00000100:00100000:3.0:1783135628.279605:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792366336:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135628.279624:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:2.0:1783135628.279631:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792366592:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135628.279680:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792366592:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 50us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135628.279685:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:2.0:1783135628.279700:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:2.0:1783135628.279705:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792366208:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135628.279706:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792366080 00000100:00100000:0.0:1783135628.279711:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792366080 00000100:00100000:0.0:1783135628.279886:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792366464 00000100:00100000:0.0:1783135628.279889:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792366464 00000100:00100000:0.0:1783135628.279898:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:0.0:1783135628.279907:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:2360:x1869752792366080:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135628.280479:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792366336:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 875us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135628.280486:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:3.0:1783135628.280506:0:14125:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1783135628.280512:0:14125:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1783135628.280592:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:3.0:1783135628.280597:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2360:x1869752792366464:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135628.280618:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2360:x1869752792366464:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 23us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135628.280622:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00080000:3.0:1783135628.282941:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783135628.282952:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783135628.282955:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783135628.282981:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792365952 00000100:00100000:3.0:1783135628.282990:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792365952 00000100:00100000:3.0:1783135628.283051:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 103 00000100:00100000:3.0:1783135628.283061:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:2360:x1869752792365952:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135628.283128:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a39050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:2360:x1869752792365952:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 68us (3664us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135628.283136:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 103 00000100:00100000:2.0:1783135628.287491:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792366208:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 7769us (8002us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135628.287509:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:1.0:1783135628.291388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135628.291844:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:2360:x1869752792366080:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 11929us (12506us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135628.291857:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:2.0:1783135628.291891:0:15725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792366720 00000100:00100000:2.0:1783135628.291901:0:15725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792366720 00000100:00100000:2.0:1783135628.291984:0:15725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:2.0:1783135628.291995:0:15725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792366720:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:2.0:1783135628.292050:0:15725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792366720:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 57us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135628.292058:0:15725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00080000:1.0:1783135628.292084:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1783135628.475558:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783135629.498642:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1783135630.152243:0:16140:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8c39e7a0 20000000:00000080:0.0:1783135630.152264:0:16140:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8e8e02384000 uarg=0000000000000000 20000000:01000000:0.0:1783135630.152304:0:16140:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783135630.152310:0:16140:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1783135630.152315:0:16140:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1783135630.153470:0:16141:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1783135630.153743:0:16140:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1783135630.161307:0:16140:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783135630.161348:0:16140:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161369:0:16140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 18 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161378:0:16140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875da3e expref: 18 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161385:0:16140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875db72 expref: 18 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161396:0:16140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 12 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161403:0:16140:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161433:0:16140:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161480:0:16140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 12 pid: 14117 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161497:0:16140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 12 pid: 14117 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.161513:0:16140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329408:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135630.161718:0:16140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 12 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161728:0:16140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 12 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.161737:0:16140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329536:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135630.161773:0:16140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875db72 expref: 18 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161781:0:16140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875db72 expref: 18 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.161790:0:16140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329664:0@lo:104: 00000100:00100000:0.0:1783135630.161873:0:16140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135630.161925:0:16140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875da3e expref: 18 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.161956:0:16140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875da3e expref: 18 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.161966:0:16140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329792:0@lo:104: 00000100:00100000:0.0:1783135630.161990:0:16140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783135630.162014:0:16140:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 18 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.162023:0:16140:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 18 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.162113:0:16140:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329920:0@lo:104: 00000100:00100000:0.0:1783135630.162140:0:16140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135630.162153:0:16140:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08911000 going to sleep for 11 seconds 00000100:00100000:2.0:1783135630.162467:0:14106:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1783135630.162480:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813329664 00000100:00100000:2.0:1783135630.162487:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813329664 00000100:00100000:2.0:1783135630.162525:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813329792 00000100:00100000:2.0:1783135630.162534:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813329792 00000100:00100000:2.0:1783135630.162549:0:14106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813329920 00000100:00100000:2.0:1783135630.162551:0:14106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813329920 00000100:00100000:2.0:1783135630.162566:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135630.162574:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+5:16140:x1869752813329664:12345-0@lo:104: 00010000:00010000:2.0:1783135630.162588:0:14106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.162653:0:14106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783135630.162659:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+5:16140:x1869752813329664:12345-0@lo:104: Request processed in 86us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135630.162666:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135630.162685:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135630.162690:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+4:16140:x1869752813329792:12345-0@lo:104: 00010000:00010000:2.0:1783135630.162698:0:14106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.162729:0:14106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783135630.162734:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+4:16140:x1869752813329792:12345-0@lo:104: Request processed in 44us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135630.162739:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135630.162750:0:14106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135630.162755:0:14106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e01916050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:16140:x1869752813329920:12345-0@lo:104: 00010000:00010000:2.0:1783135630.162763:0:14106:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.162787:0:14106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783135630.162791:0:14106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e01916050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+3:16140:x1869752813329920:12345-0@lo:104: Request processed in 37us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135630.162803:0:14106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1783135630.162868:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783135630.162874:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.162881:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3800 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135630.162885:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.162895:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135630.162902:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135630.162908:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135630.162951:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.162957:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135630.162980:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.162986:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3800/0xf646e0cda875db72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875db79 expref: -99 pid: 15429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.162998:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783135630.163001:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163016:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042600 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135630.163020:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163026:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135630.163171:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135630.163176:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135630.163191:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163197:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135630.163203:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163208:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f3d042600/0xf646e0cda875da3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875da45 expref: -99 pid: 14758 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163217:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783135630.163219:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163225:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121d400 already unused, calling callback (ffffffffc1cfec20) 10000000:00010000:2.0:1783135630.163227:0:14112:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163295:0:14112:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783135630.163301:0:14112:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783135630.163306:0:14112:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783135630.163320:0:14112:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163326:0:14112:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783135630.163344:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163352:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d400/0xf646e0cda875d9f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xf646e0cda875d9f8 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163364:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135630.163366:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135630.163368:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783135630.163376:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135630.163395:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3313:1869752813330048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135630.163429:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135630.163458:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135630.163464:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3313:1869752813330176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135630.163484:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135630.163510:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3311:1869752813330304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135630.163533:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135630.163573:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813330048 00000100:00100000:2.0:1783135630.163578:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813330048 00010000:00010000:2.0:1783135630.163597:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875db72 expref: 19 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135630.163612:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813330176 00000100:00100000:2.0:1783135630.163614:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813330176 00010000:00010000:2.0:1783135630.163623:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875da3e expref: 20 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135630.163633:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813330304 00000100:00100000:2.0:1783135630.163635:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813330304 00010000:00010000:2.0:1783135630.163645:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 21 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135630.163658:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135630.163664:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+21:3313:x1869752813330048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135630.163673:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135630.163678:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875db72 expref: 21 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163687:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875db72 expref: 21 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163703:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135630.163728:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+21:3313:x1869752813330048:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135630.163735:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783135630.163747:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135630.163753:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+20:3313:x1869752813330176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135630.163767:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135630.163772:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875da3e expref: 20 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163780:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875da3e expref: 20 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163789:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135630.163807:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+20:3313:x1869752813330176:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135630.163839:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783135630.163851:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135630.163857:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f338b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3311:x1869752813330304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783135630.163863:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135630.163867:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 19 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163875:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 19 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.163883:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783135630.163907:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f338b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3311:x1869752813330304:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135630.163913:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783135630.163982:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3311:1869752813330304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135630.164005:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3313:1869752813330176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783135630.164012:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3313:1869752813330048:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783135630.164266:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3d043c00/0xf646e0cda875db79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875db72 expref: 18 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.164279:0:16140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dc380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329664:0@lo:104: 00010000:00010000:0.0:1783135630.164290:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f0121c600/0xf646e0cda875da45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875da3e expref: 17 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.164299:0:16140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329792:0@lo:104: 00010000:00010000:0.0:1783135630.164306:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875d9f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xf646e0cda875d9f1 expref: 16 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.164313:0:16140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329920:0@lo:104: 00000100:00100000:0.0:1783135630.169040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135630.169085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135630.169249:0:16140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329408:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135630.169261:0:16140:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3ded80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16140:1869752813329536:192.168.201.60@tcp:104: 00010000:00010000:1.0:1783135630.169291:0:16140:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135630.169389:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792366976 00000100:00100000:3.0:1783135630.169396:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792366976 00010000:00010000:3.0:1783135630.170122:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 13 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135630.170253:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792366848 00000100:00100000:3.0:1783135630.170257:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792366848 00010000:00010000:3.0:1783135630.170274:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 14 pid: 14117 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135630.170373:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:0.0:1783135630.170386:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f021332-5796-4bf3-99ee-d085123cca02+14:2361:x1869752792366976:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135630.170403:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135630.170410:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 14 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170421:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 14 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170440:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b3a00/0xf646e0cda875dc9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab121ea expref: 14 pid: 14118 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170453:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135630.170524:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f021332-5796-4bf3-99ee-d085123cca02+13:2361:x1869752792366976:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 139us (1504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135630.170531:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:0.0:1783135630.170550:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:0.0:1783135630.170556:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f021332-5796-4bf3-99ee-d085123cca02+12:2361:x1869752792366848:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783135630.170564:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135630.170568:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 12 pid: 14117 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170577:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 12 pid: 14117 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170587:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f123b2200/0xf646e0cda875dcd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1224c expref: 12 pid: 14117 timeout: 629 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170620:0:14109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170629:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170644:0:14109:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170650:0:14109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170656:0:14109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170662:0:14109:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170667:0:14109:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:0.0:1783135630.170671:0:14109:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170678:0:14109:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170689:0:14109:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135630.170699:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135630.170717:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6f021332-5796-4bf3-99ee-d085123cca02+11:2361:x1869752792366848:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 161us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135630.170728:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00010000:00010000:1.0:1783135630.171160:0:16140:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135630.171170:0:16140:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135630.171177:0:16140:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8e8f3d043600/0xf646e0cda875dd01 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16140 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135630.522186:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135631.569506:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783135631.613055:0:14120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783135631.613062:0:14120:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f10b6c800 from 10 10000000:01000000:2.0:1783135631.613068:0:14120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783135631.613110:0:14120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3200/0xf646e0cda875dd08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135631.613121:0:14120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3200/0xf646e0cda875dd08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135631.613132:0:14120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3200/0xf646e0cda875dd08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135631.613156:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783135631.613240:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135631.613288:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09356480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135631.613381:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813330432 00000100:00100000:1.0:1783135631.613388:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813330432 00000100:00100000:1.0:1783135631.613439:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783135631.613448:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+16:14120:x1869752813330432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783135631.613470:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135631.613482:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f0121da00/0xf646e0cda875dd0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875dd08 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135631.613505:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f0121da00/0xf646e0cda875dd0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875dd08 expref: 17 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135631.613517:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f0121da00/0xf646e0cda875dd0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875dd08 expref: 17 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135631.613526:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121da00, rc 0) 00000100:00100000:1.0:1783135631.613573:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a39850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:14120:x1869752813330432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135631.613580:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783135631.613941:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135631.613956:0:14120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3200/0xf646e0cda875dd08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd0f expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135631.613964:0:14120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3200/0xf646e0cda875dd08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875dd0f expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135631.614028:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783135631.614053:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135631.614076:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09356480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135631.614109:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813330560 00000100:00100000:1.0:1783135631.614112:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813330560 00000100:00100000:1.0:1783135631.614136:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783135631.614141:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:14120:x1869752813330560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135631.614356:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a38050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:14120:x1869752813330560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 214us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135631.614361:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783135631.614383:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783135631.614403:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135631.614431:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135631.614439:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04db2480 going to sleep for 11 seconds 00000100:00100000:1.0:1783135631.614447:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813330688 00000100:00100000:1.0:1783135631.614450:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813330688 00000100:00100000:1.0:1783135631.614469:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783135631.614474:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:14120:x1869752813330688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783135631.614585:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:14120:x1869752813330688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135631.614590:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1783135631.614613:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783135631.615405:0:16182:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783135631.615656:0:14120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783135631.615671:0:14120:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783135631.615679:0:14120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3200/0xf646e0cda875dd08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd0f expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135631.615685:0:14120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f123b3200/0xf646e0cda875dd08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd0f expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783135631.615692:0:14120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783135631.615694:0:14120:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8e0182e000 from 10 10000000:01000000:1.0:1783135631.615695:0:14120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783135631.615715:0:14120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d000/0xf646e0cda875dd16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135631.615720:0:14120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d000/0xf646e0cda875dd16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135631.615727:0:14120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d000/0xf646e0cda875dd16 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135631.615740:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783135631.615772:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135631.615806:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f04db2480 going to sleep for 11 seconds 00000100:00100000:2.0:1783135631.619099:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813330816 00000100:00100000:2.0:1783135631.619111:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813330816 00000100:00100000:2.0:1783135631.619189:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783135631.619198:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+17:14120:x1869752813330816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783135631.619225:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135631.619244:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f123b3e00/0xf646e0cda875dd1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875dd16 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135631.619271:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f123b3e00/0xf646e0cda875dd1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875dd16 expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135631.619282:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f123b3e00/0xf646e0cda875dd1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875dd16 expref: 18 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135631.619292:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3e00, rc 0) 00000100:00100000:2.0:1783135631.619373:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:14120:x1869752813330816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (3598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135631.619380:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783135631.625997:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b80e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135631.626029:0:14120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d000/0xf646e0cda875dd16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd1d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.626042:0:14120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d000/0xf646e0cda875dd16 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875dd1d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135631.626131:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.626205:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135631.626244:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c099c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135631.626665:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813330944 00000100:00100000:2.0:1783135631.626672:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813330944 00000100:00100000:2.0:1783135631.626732:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783135631.626744:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:14120:x1869752813330944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135631.627163:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:14120:x1869752813330944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 420us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135631.627173:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783135631.627196:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813330944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.627240:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813331072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.627362:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135631.627395:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f37c099c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783135631.627429:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813331072 00000100:00100000:3.0:1783135631.627435:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813331072 00000100:00100000:3.0:1783135631.627467:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783135631.627475:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:14120:x1869752813331072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135631.627603:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a39450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:14120:x1869752813331072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135631.627608:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783135631.627642:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813331072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783135631.631945:0:16183:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783135631.632024:0:14120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783135631.632054:0:14120:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783135631.632066:0:14120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d000/0xf646e0cda875dd16 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd1d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.632078:0:14120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f0121d000/0xf646e0cda875dd16 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd1d expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783135631.632088:0:14120:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1783135631.632098:0:14120:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff8e8f0aafe000 from 10 10000000:01000000:0.0:1783135631.632101:0:14120:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1783135631.632152:0:14120:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d043c00/0xf646e0cda875dd24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.632160:0:14120:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.160@tcp lock: ffff8e8f3d043c00/0xf646e0cda875dd24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.632172:0:14120:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.160@tcp lock: ffff8e8f3d043c00/0xf646e0cda875dd24 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135631.632200:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813331200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.632551:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135631.632598:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135631.632746:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813331200 00000100:00100000:0.0:1783135631.632754:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813331200 00000100:00100000:0.0:1783135631.632806:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783135631.632840:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+18:14120:x1869752813331200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135631.632855:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135631.632867:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875dd2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xf646e0cda875dd24 expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.632892:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875dd2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xf646e0cda875dd24 expref: 19 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.632901:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3d043a00/0xf646e0cda875dd2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xf646e0cda875dd24 expref: 19 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.632921:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043a00, rc 0) 00000100:00100000:0.0:1783135631.632964:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a38850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:14120:x1869752813331200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 149us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135631.632976:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783135631.633028:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813331200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135631.633044:0:14120:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.160@tcp lock: ffff8e8f3d043c00/0xf646e0cda875dd24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd2b expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.633053:0:14120:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.160@tcp lock: ffff8e8f3d043c00/0xf646e0cda875dd24 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xf646e0cda875dd2b expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135631.633101:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813331328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.633127:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135631.633145:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135631.633156:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813331328 00000100:00100000:0.0:1783135631.633159:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813331328 00000100:00100000:0.0:1783135631.633177:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783135631.633182:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:14120:x1869752813331328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.633448:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:14120:x1869752813331328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135631.633455:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783135631.633484:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813331328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.633509:0:14120:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813331456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.633548:0:14120:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135631.633561:0:14120:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262480 going to sleep for 11 seconds 00000100:00100000:0.0:1783135631.633573:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813331456 00000100:00100000:0.0:1783135631.633576:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813331456 00000100:00100000:0.0:1783135631.633592:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783135631.633605:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f10a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:14120:x1869752813331456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.633749:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f10a3a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:14120:x1869752813331456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135631.633756:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783135631.633794:0:14120:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:14120:1869752813331456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783135631.634447:0:16184:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1783135631.635299:0:14120:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1783135631.635325:0:14120:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783135631.635335:0:14120:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.160@tcp lock: ffff8e8f3d043c00/0xf646e0cda875dd24 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd2b expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135631.635346:0:14120:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.160@tcp lock: ffff8e8f3d043c00/0xf646e0cda875dd24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xf646e0cda875dd2b expref: -99 pid: 14120 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135631.878050:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135631.878921:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792367104 00000100:00100000:0.0:1783135631.878932:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792367104 00000100:00100000:0.0:1783135631.878988:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 113 00000100:00100000:0.0:1783135631.880100:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+11:13711:x1869752792367104:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783135631.880129:0:14116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135631.880151:0:14116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f3d043e00/0xf646e0cda875dd32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1227d expref: -99 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.880199:0:14116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f3d043e00/0xf646e0cda875dd32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1227d expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.880211:0:14116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f3d043e00/0xf646e0cda875dd32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1227d expref: 12 pid: 14116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135631.880222:0:14116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043e00, rc 0) 00000100:00100000:0.0:1783135631.880290:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+12:13711:x1869752792367104:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 Request processed in 1292us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135631.880297:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 113 00000100:00100000:1.0:1783135631.884162:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135631.885055:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792367232 00000100:00100000:0.0:1783135631.885067:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792367232 00000100:00100000:0.0:1783135631.885120:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 114 00000100:00100000:0.0:1783135631.885137:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+12:13711:x1869752792367232:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.885529:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+12:13711:x1869752792367232:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 Request processed in 393us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135631.885537:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 114 00000100:00100000:0.0:1783135631.893880:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135631.893934:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792367360 00000100:00100000:3.0:1783135631.893944:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792367360 00000100:00100000:3.0:1783135631.894013:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 115 00000100:00100000:3.0:1783135631.894025:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+12:13711:x1869752792367360:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783135631.894273:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+12:13711:x1869752792367360:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 Request processed in 250us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135631.894281:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 115 00000100:00100000:0.0:1783135631.923938:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135631.924475:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792367488 00000100:00100000:3.0:1783135631.924487:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792367488 00000100:00100000:3.0:1783135631.924544:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 116 00000100:00100000:3.0:1783135631.924554:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+12:13711:x1869752792367488:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783135631.924578:0:14118:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135631.925037:0:14118:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875dd39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12284 expref: -99 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135631.925071:0:14118:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875dd39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12284 expref: 13 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135631.925081:0:14118:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8e8f02c38200/0xf646e0cda875dd39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12284 expref: 13 pid: 14118 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135631.925091:0:14118:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38200, rc 0) 00000100:00100000:3.0:1783135631.925158:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+13:13711:x1869752792367488:12345-192.168.201.60@tcp:101:ll_cfg_requeue.0 Request processed in 605us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135631.925166:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 116 00000100:00100000:1.0:1783135631.930226:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135631.930454:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792367616 00000100:00100000:3.0:1783135631.930464:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792367616 00000100:00100000:3.0:1783135631.930528:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 117 00000100:00100000:3.0:1783135631.930540:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+13:13711:x1869752792367616:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783135631.930880:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6f021332-5796-4bf3-99ee-d085123cca02+13:13711:x1869752792367616:12345-192.168.201.60@tcp:501:ll_cfg_requeue.0 Request processed in 341us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135631.930895:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 117 00000100:00100000:1.0:1783135631.936313:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135631.936536:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792367744 00000100:00100000:0.0:1783135631.936547:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792367744 00000100:00100000:0.0:1783135631.936601:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 118 00000100:00100000:0.0:1783135631.936612:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:13711:x1869752792367744:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783135631.936875:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:13711:x1869752792367744:12345-192.168.201.60@tcp:503:ll_cfg_requeue.0 Request processed in 262us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135631.936883:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 118 00000100:00100000:2.0:1783135631.994012:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813331968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994094:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135631.994159:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783135631.994165:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813331584:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994193:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135631.994217:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813332096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994239:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135631.994286:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813331712:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135631.994328:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783135631.994334:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813331840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994355:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135631.994389:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813331968 00000100:00100000:2.0:1783135631.994396:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813331968 00000100:00100000:2.0:1783135631.994458:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813332096 00000100:00100000:2.0:1783135631.994462:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813332096 00000100:00100000:2.0:1783135631.994478:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813331840 00000100:00100000:2.0:1783135631.994480:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813331840 00000100:00100000:2.0:1783135631.994494:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135631.994502:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813331968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994551:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813331968:12345-0@lo:400:kworker.0 Request processed in 50us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135631.994558:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783135631.994574:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135631.994579:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813332096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994600:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869752813332096:12345-0@lo:400:kworker.0 Request processed in 22us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135631.994605:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783135631.994613:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135631.994617:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813331840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994640:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869752813331840:12345-0@lo:400:kworker.0 Request processed in 22us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135631.994645:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783135631.994661:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813331584 00000100:00100000:2.0:1783135631.994668:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813331584 00000100:00100000:2.0:1783135631.994688:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813331712 00000100:00100000:2.0:1783135631.994690:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813331712 00000100:00100000:2.0:1783135631.994705:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135631.994710:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813331584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994736:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813331584:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135631.994741:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783135631.994750:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135631.994754:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813331712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.994773:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813331712:12345-0@lo:400:kworker.0 Request processed in 19us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135631.994777:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1783135631.994795:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783135631.994799:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783135631.994801:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135631.996733:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869752813331840:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.996759:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813331712:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.996808:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813331584:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.996842:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3311:1869752813332096:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.996858:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813331968:0@lo:400:kworker.0 00000100:00100000:2.0:1783135631.998922:0:3314:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783135631.998943:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813332224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135631.999013:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135631.999105:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813332224 00000100:00100000:0.0:1783135631.999113:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813332224 00000100:00100000:0.0:1783135631.999164:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783135631.999173:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813332224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783135631.999212:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135631.999260:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813332224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135631.999267:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783135632.003133:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813332224:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1783135632.571678:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135633.018106:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f37b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813332352:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783135633.018221:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783135633.018284:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813332352 00000100:00100000:0.0:1783135633.018296:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813332352 00000100:00100000:0.0:1783135633.018389:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783135633.018402:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813332352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783135633.018449:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783135633.018547:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813332352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135633.018555:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1783135633.018580:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783135633.018754:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f37b80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813332352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783135633.401349:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135633.401397:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135633.401431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135633.401447:0:14118:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792367872 00000100:00100000:0.0:1783135633.401456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135633.401457:0:14118:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792367872 00000100:00100000:0.0:1783135633.401472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135633.401486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135633.401504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135633.401511:0:14118:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 119 00000100:00100000:1.0:1783135633.401521:0:14118:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+13:2360:x1869752792367872:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135633.401525:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792368128 00000100:00100000:0.0:1783135633.401528:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792368128 00000100:00100000:0.0:1783135633.401557:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792368640 00000100:00100000:0.0:1783135633.401559:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792368640 00000100:00100000:0.0:1783135633.401570:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792368256 00000100:00100000:0.0:1783135633.401572:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792368256 00000100:00100000:0.0:1783135633.401581:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792368512 00000100:00100000:0.0:1783135633.401583:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792368512 00000100:00100000:0.0:1783135633.401595:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:0.0:1783135633.401601:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792368128:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:1.0:1783135633.401603:0:14118:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6f021332-5796-4bf3-99ee-d085123cca02+13:2360:x1869752792367872:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 84us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135633.401610:0:14118:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 119 00000100:00100000:0.0:1783135633.401629:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792368128:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 29us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135633.401636:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:0.0:1783135633.401646:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:0.0:1783135633.401652:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792368640:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135633.401673:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792368640:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 22us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135633.401698:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:0.0:1783135633.401709:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:0.0:1783135633.401715:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792368256:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135633.401738:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792368256:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 23us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135633.401744:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:0.0:1783135633.401755:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:0.0:1783135633.401761:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792368512:12345-192.168.201.60@tcp:400:kworker.0 00000100:00080000:1.0:1783135633.401768:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783135633.401772:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135633.401791:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792368512:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135633.401797:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:3.0:1783135633.401958:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792368384 00000100:00100000:3.0:1783135633.401963:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792368384 00000100:00100000:3.0:1783135633.402008:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792368000 00000100:00100000:3.0:1783135633.402011:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792368000 00000100:00100000:3.0:1783135633.402029:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:3.0:1783135633.402036:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2360:x1869752792368384:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135633.402071:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2360:x1869752792368384:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 36us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135633.402077:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:3.0:1783135633.402088:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:3.0:1783135633.402094:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+6:2360:x1869752792368000:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:3.0:1783135633.402117:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+6:2360:x1869752792368000:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 23us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135633.402122:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00080000:0.0:1783135633.402221:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783135633.594184:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135634.106479:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783135634.359055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135634.359167:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792368768 00000100:00100000:3.0:1783135634.359193:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792368768 00000100:00100000:3.0:1783135634.359261:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:3.0:1783135634.359273:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+6:14366:x1869752792368768:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135634.359296:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135634.359319:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875dd40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1228b expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.359407:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.359420:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.359433:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.359447:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.359453:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.359459:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362478:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875dd55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362508:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875dd55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362521:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875dd55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135634.362618:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783135634.362622:0:14125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135634.362725:0:14125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875dd55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362754:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362760:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362767:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362773:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135634.362777:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362785:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362800:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:3.0:1783135634.362802:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135634.362807:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362840:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875dd47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362854:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362874:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362880:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362891:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135634.362895:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362901:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362910:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8e8f18315200) 00010000:00010000:3.0:1783135634.362913:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135634.362916:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362922:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875dd4e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362962:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875dd40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1228b expref: 8 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362975:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38000/0xf646e0cda875dd55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1228b expref: 7 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.362982:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8f18315300) 00010000:00010000:3.0:1783135634.362985:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135634.362987:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38000, rc 0) 00000100:00100000:3.0:1783135634.363069:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+7:14366:x1869752792368768:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 3798us (4026us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135634.363078:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:3.0:1783135634.381074:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.381228:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792369024 00000100:00100000:0.0:1783135634.381240:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792369024 00000100:00100000:0.0:1783135634.381309:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:0.0:1783135634.381320:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+7:14366:x1869752792369024:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135634.381343:0:16058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135634.381362:0:16058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12292 expref: -99 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.381443:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.381458:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.381480:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.381531:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.381539:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.381546:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.387055:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875dd71 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.387079:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875dd71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.387092:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875dd71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135634.387106:0:16058:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783135634.390247:0:16058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390266:0:16058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390274:0:16058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390281:0:16058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135634.390293:0:16058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390300:0:16058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390318:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8e8f18315300) 00010000:00010000:0.0:1783135634.390321:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.390326:0:16058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390332:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dd63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390345:0:16058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390351:0:16058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390356:0:16058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390361:0:16058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135634.390364:0:16058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390369:0:16058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390376:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8e8f1a154700) 00010000:00010000:0.0:1783135634.390378:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.390385:0:16058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390390:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875dd6a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390848:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12292 expref: 10 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390880:0:16058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042400/0xf646e0cda875dd71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12292 expref: 9 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.390888:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f1a154300) 00010000:00010000:0.0:1783135634.390890:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.390892:0:16058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042400, rc 0) 00000100:00100000:0.0:1783135634.390973:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+9:14366:x1869752792369024:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 9655us (9908us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1783135634.390981:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:1.0:1783135634.404268:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.404352:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792369152 00000100:00100000:0.0:1783135634.404364:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792369152 00000100:00100000:0.0:1783135634.404431:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:0.0:1783135634.404441:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+9:14366:x1869752792369152:12345-192.168.201.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783135634.404566:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+9:14366:x1869752792369152:12345-192.168.201.60@tcp:59:lhsmtool_posix.0 Request processed in 126us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135634.404574:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:1.0:1783135634.432136:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135634.432325:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792369280 00000100:00100000:2.0:1783135634.432335:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792369280 00000100:00100000:2.0:1783135634.432406:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:2.0:1783135634.432417:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+9:14372:x1869752792369280:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135634.432440:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135634.432465:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dd7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12299 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432540:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432554:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432566:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432580:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432586:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432592:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432921:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432929:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432943:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432949:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135634.432953:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432961:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432973:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:2.0:1783135634.432977:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135634.432982:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.432989:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875dd86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433002:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433008:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433013:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433018:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3a00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135634.433021:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433038:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433046:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8f09ec5200) 00010000:00010000:2.0:1783135634.433048:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135634.433051:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433056:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dd8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433086:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dd7f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12299 expref: 10 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433096:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:2.0:1783135634.433098:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135634.433101:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dd7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12299 expref: 10 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.433112:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3800, rc 0) 00000100:00100000:2.0:1783135634.433170:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+9:14372:x1869752792369280:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 755us (1045us total) trans 0 rc 301/301 00000100:00100000:2.0:1783135634.433178:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:1.0:1783135634.440845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.440962:0:14132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792369408 00000100:00100000:0.0:1783135634.440981:0:14132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792369408 00000100:00100000:0.0:1783135634.441063:0:14132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:0.0:1783135634.441074:0:14132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ceb6e8e3-b75e-4201-a568-34429b542814+9:14372:x1869752792369408:12345-192.168.201.60@tcp:700:lfs.0 00000100:00100000:0.0:1783135634.441222:0:14132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ceb6e8e3-b75e-4201-a568-34429b542814+9:14372:x1869752792369408:12345-192.168.201.60@tcp:700:lfs.0 Request processed in 149us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135634.441230:0:14132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:1.0:1783135634.446809:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.447025:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792369664 00000100:00100000:0.0:1783135634.447045:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792369664 00000100:00100000:0.0:1783135634.447134:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:0.0:1783135634.447151:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+9:14372:x1869752792369664:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:0.0:1783135634.447388:0:14123:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135634.447419:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875dcc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12214 expref: 9 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.447439:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:0.0:1783135634.447444:0:14123:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135634.447738:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.447755:0:14123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 5 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.447764:0:14123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.447799:0:14123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 5 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.448268:0:14123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 5 pid: 14124 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135634.448300:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869752813332480:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135634.448401:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f082620c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783135634.454891:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.455130:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3df100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869752813332480:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135634.455166:0:14123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135634.455472:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792369792 00000100:00100000:3.0:1783135634.455486:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792369792 00010000:00010000:3.0:1783135634.455541:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 6 pid: 14124 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135634.455588:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:3.0:1783135634.455597:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2361:x1869752792369792:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135634.455618:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135634.455625:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 6 pid: 14124 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.455640:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 6 pid: 14124 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.455670:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875dcfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12276 expref: 6 pid: 14124 timeout: 633 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.455686:0:14110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:3.0:1783135634.455691:0:14110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.455700:0:14110:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.455707:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.455730:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135634.455793:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2361:x1869752792369792:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 196us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135634.455844:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00010000:00010000:1.0:1783135634.456681:0:14123:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.456695:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.456730:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.456750:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.456759:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135634.459809:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783135634.460004:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.460016:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.460021:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.460026:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135634.460031:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.460038:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.460060:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f1a154600) 00010000:00010000:1.0:1783135634.460063:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135634.460070:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.460077:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875dd94 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783135634.460128:0:14123:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f8f6028 reply state 00000000d7de1f84 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135634.460140:0:14123:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783135634.460535:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+10:14372:x1869752792369664:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 13385us (13736us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1783135634.460544:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 19 00010000:00010000:2.0:1783135634.463726:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.463747:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.463774:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.463781:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121cc00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135634.463786:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.463794:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.463833:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8f03a45f00) 00010000:00010000:2.0:1783135634.463838:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783135634.463843:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.463849:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875dd9b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135634.539773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135634.540002:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792369920 00000100:00100000:2.0:1783135634.540020:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792369920 00000100:00100000:2.0:1783135634.540107:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:2.0:1783135634.540118:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+9:14380:x1869752792369920:12345-192.168.201.60@tcp:101:lctl.0 00010000:00010000:2.0:1783135634.540143:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135634.540169:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dda2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122a0 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.540237:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dda9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.540271:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dda9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.540282:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dda9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135634.540351:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783135634.540355:0:14124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135634.540396:0:14124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dda9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.540422:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dda2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122a0 expref: 11 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.540441:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3a00/0xf646e0cda875dda9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122a0 expref: 10 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.540449:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f09ec5200) 00010000:00010000:2.0:1783135634.540452:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135634.540455:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3a00, rc 0) 00000100:00100000:2.0:1783135634.546658:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+10:14380:x1869752792369920:12345-192.168.201.60@tcp:101:lctl.0 Request processed in 6525us (7124us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135634.546675:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:3.0:1783135634.586927:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135634.587610:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792370048 00000100:00100000:2.0:1783135634.587622:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792370048 00000100:00100000:2.0:1783135634.587694:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:2.0:1783135634.587706:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+5:14381:x1869752792370048:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:2.0:1783135634.587728:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135634.587764:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875ddb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122a7 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.587893:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ddb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.587909:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ddb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.587922:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ddb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135634.587991:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783135634.587995:0:14125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1783135634.588024:0:14125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ddb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.588049:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875ddb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122a7 expref: 7 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.588068:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2200/0xf646e0cda875ddb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122a7 expref: 6 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.588077:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f09ec5200) 00010000:00010000:2.0:1783135634.588080:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783135634.588084:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2200, rc 0) 00000100:00100000:2.0:1783135634.590706:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+6:14381:x1869752792370048:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 2990us (3778us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135634.590719:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:0.0:1783135634.610408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135634.614790:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792370176 00000100:00100000:3.0:1783135634.614811:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792370176 00000100:00100000:3.0:1783135634.614938:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:3.0:1783135634.614952:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2ce35c1-9280-4944-a51c-87d3518837f6+6:14381:x1869752792370176:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:3.0:1783135634.615098:0:16058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135634.615245:0:16058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875ddbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122ae expref: -99 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615454:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615473:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615487:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615504:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615511:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615517:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615933:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875ddd3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615973:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875ddd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.615986:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875ddd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783135634.616057:0:16058:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783135634.616062:0:16058:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783135634.616774:0:16058:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875ddd3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616793:0:16058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616800:0:16058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616807:0:16058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616813:0:16058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135634.616846:0:16058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616855:0:16058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616880:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f09ec5200) 00010000:00010000:3.0:1783135634.616883:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135634.616888:0:16058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616909:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38400/0xf646e0cda875ddc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616927:0:16058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616934:0:16058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616940:0:16058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616945:0:16058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135634.616948:0:16058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616954:0:16058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.616963:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8f18315200) 00010000:00010000:3.0:1783135634.616965:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135634.617764:0:16058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.617779:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875ddcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.617931:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38e00/0xf646e0cda875ddbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122ae expref: 8 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.617964:0:16058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875ddd3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122ae expref: 7 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.618180:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8f18315b00) 00010000:00010000:3.0:1783135634.618183:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783135634.618186:0:16058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38800, rc 0) 00000100:00100000:2.0:1783135634.618540:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a2ce35c1-9280-4944-a51c-87d3518837f6+7:14381:x1869752792370176:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 3588us (8230us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135634.618561:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 22 00010000:00010000:1.0:1783135634.623076:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783135634.627932:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135634.628266:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792370432 00000100:00100000:1.0:1783135634.628280:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792370432 00000100:00100000:1.0:1783135634.628353:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:1.0:1783135634.628364:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+7:14381:x1869752792370432:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:1.0:1783135634.628384:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135634.628405:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875ddda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122b5 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135634.628535:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1783135634.628662:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875ddda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122b5 expref: 9 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.628807:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f09ec5200) 00010000:00010000:1.0:1783135634.628811:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135634.628901:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875ddda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122b5 expref: 9 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.628918:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121cc00, rc 0) 00000100:00100000:1.0:1783135634.629098:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+8:14381:x1869752792370432:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 735us (1174us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1783135634.629118:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 23 00000100:00100000:3.0:1783135634.641446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135634.641532:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792370688 00000100:00100000:2.0:1783135634.641544:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792370688 00000100:00100000:2.0:1783135634.641604:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:2.0:1783135634.641615:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+8:14381:x1869752792370688:12345-192.168.201.60@tcp:36:lfs.0 00010000:00010000:2.0:1783135634.641674:0:14124:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783135634.641704:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38800/0xf646e0cda875ddd3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122ae expref: 8 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.641722:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8f18315b00) 00010000:00010000:2.0:1783135634.641732:0:14124:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135634.641757:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.641770:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135634.641782:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783135634.642074:0:14124:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000001f75db64 reply state 000000004924cce5 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135634.642276:0:14124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783135634.642291:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1783135634.642384:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+9:14381:x1869752792370688:12345-192.168.201.60@tcp:36:lfs.0 Request processed in 771us (948us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783135634.642393:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 24 00000100:00100000:0.0:1783135634.645864:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135634.646234:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792370944 00000100:00100000:3.0:1783135634.646243:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792370944 00000100:00100000:3.0:1783135634.646300:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:3.0:1783135634.646309:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+9:14381:x1869752792370944:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1783135634.646569:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+10:14381:x1869752792370944:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 259us (758us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1783135634.646578:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2 00010000:00010000:1.0:1783135634.646906:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.646919:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.646928:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.646934:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135634.646939:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.646947:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.646962:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8f09ec5300) 00010000:00010000:1.0:1783135634.646965:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1783135634.646980:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135634.646987:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875dde8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135634.654217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.654393:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792371200 00000100:00100000:0.0:1783135634.654403:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792371200 00000100:00100000:0.0:1783135634.654466:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:0.0:1783135634.654476:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+9:14381:x1869752792371200:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135634.654500:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135634.654519:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875ddef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122bc expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654597:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654612:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654623:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654637:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654662:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654668:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135634.654846:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783135634.654951:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654959:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654965:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654982:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135634.654986:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.654993:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655006:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f09ec5200) 00010000:00010000:0.0:1783135634.655010:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.655014:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655021:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875ddf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655045:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655052:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655058:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655063:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135634.655067:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655073:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655080:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8f1a154700) 00010000:00010000:0.0:1783135634.655082:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.655085:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655090:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875ddfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655127:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875ddef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122bc expref: 11 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655137:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f09ec5200) 00010000:00010000:0.0:1783135634.655140:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135634.655150:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875ddef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122bc expref: 11 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.655160:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043000, rc 0) 00000100:00100000:0.0:1783135634.655221:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a2ce35c1-9280-4944-a51c-87d3518837f6+10:14381:x1869752792371200:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 747us (1014us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1783135634.655229:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 25 00000100:00100000:2.0:1783135634.661457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.661894:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792371328 00000100:00100000:0.0:1783135634.661905:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792371328 00000100:00100000:0.0:1783135634.661977:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 26 00000100:00100000:0.0:1783135634.661988:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+10:14381:x1869752792371328:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135634.662011:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135634.662033:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de0b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122c3 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.662118:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.662133:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.662145:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135634.662201:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783135634.662204:0:14124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135634.662223:0:14124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.662247:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de0b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 12 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.662277:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 11 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.662285:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8f1a154700) 00010000:00010000:0.0:1783135634.662289:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783135634.662292:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042c00, rc 0) 00000100:00100000:0.0:1783135634.662353:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+11:14381:x1869752792371328:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 367us (916us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135634.662360:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 26 00000100:00100000:2.0:1783135634.669209:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135634.670481:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792371456 00000100:00100000:3.0:1783135634.670495:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792371456 00000100:00100000:3.0:1783135634.670557:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:3.0:1783135634.670566:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+11:14381:x1869752792371456:12345-192.168.201.60@tcp:37:lfs.0 00000100:00100000:0.0:1783135634.685312:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+11:14381:x1869752792371456:12345-192.168.201.60@tcp:37:lfs.0 Request processed in 14736us (16103us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135634.685332:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:2.0:1783135634.696207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.697092:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792371712 00000100:00100000:0.0:1783135634.697104:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792371712 00000100:00100000:0.0:1783135634.697177:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:0.0:1783135634.697187:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fc69050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+11:14381:x1869752792371712:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:0.0:1783135634.697442:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fc69050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a2ce35c1-9280-4944-a51c-87d3518837f6+12:14381:x1869752792371712:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 255us (1244us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1783135634.697451:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:1.0:1783135634.804925:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.805222:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792371840 00000100:00100000:0.0:1783135634.805242:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792371840 00000100:00100000:0.0:1783135634.805347:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 27 00000100:00100000:0.0:1783135634.805360:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+10:14387:x1869752792371840:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135634.805383:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135634.805421:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122ca expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805495:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805510:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805521:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805535:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805543:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805549:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805661:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875de2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805679:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875de2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.805687:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875de2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135634.805720:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783135634.805723:0:14125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135634.805763:0:14125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875de2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806018:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806026:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806032:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806038:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135634.806042:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806048:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806060:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f09ec5200) 00010000:00010000:0.0:1783135634.806062:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.806066:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806071:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875de20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806085:0:14125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806090:0:14125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806095:0:14125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806106:0:14125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135634.806108:0:14125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806113:0:14125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806120:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8e8f1a154900) 00010000:00010000:0.0:1783135634.806122:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.806124:0:14125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806130:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806163:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122ca expref: 12 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806177:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043600/0xf646e0cda875de2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122ca expref: 11 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.806185:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8f1a154700) 00010000:00010000:0.0:1783135634.806188:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1783135634.806190:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043600, rc 0) 00000100:00100000:0.0:1783135634.806253:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+11:14387:x1869752792371840:12345-192.168.201.60@tcp:101:bash.0 Request processed in 896us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135634.806261:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 27 00000100:00100000:1.0:1783135634.820648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.823284:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792372096 00000100:00100000:0.0:1783135634.823316:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792372096 00000100:00100000:0.0:1783135634.823380:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:0.0:1783135634.823392:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+11:14387:x1869752792372096:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135634.823416:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135634.823454:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de35 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122d1 expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.823586:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.823600:0:14124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 11 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.823608:0:14124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.823642:0:14124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 11 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.823654:0:14124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 11 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135634.823669:0:14124:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14124:1869752813332608:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135634.823780:0:14124:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783135634.839021:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.839401:0:14124:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14124:1869752813332608:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135634.839450:0:14124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135634.839557:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792372224 00000100:00100000:3.0:1783135634.839569:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792372224 00010000:00010000:3.0:1783135634.839632:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 12 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135634.839708:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:3.0:1783135634.839725:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+12:2360:x1869752792372224:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135634.839744:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135634.839752:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 12 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.839765:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 12 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.839793:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875de12 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122c3 expref: 12 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.840336:0:14108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8f1a154700) 00010000:00010000:3.0:1783135634.840344:0:14108:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.840357:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.840427:0:14108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135634.840462:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135634.840545:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+11:2360:x1869752792372224:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 819us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135634.840554:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00010000:00010000:0.0:1783135634.840690:0:14124:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.840700:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.840729:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.840741:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.840749:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850364:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850396:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850410:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135634.850427:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135634.850467:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850474:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850482:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850509:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135634.850514:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850523:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850539:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8f1a154700) 00010000:00010000:0.0:1783135634.850543:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.850548:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850554:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de3c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135634.850570:0:14124:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000055b667f reply state 000000001ac2ed2c transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135634.850592:0:14124:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1783135634.850641:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de35 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 14 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850659:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 13 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.850667:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:0.0:1783135634.850670:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1783135634.850672:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042600, rc 0) 00000100:00100000:0.0:1783135634.850767:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+14:14387:x1869752792372096:12345-192.168.201.60@tcp:101:bash.0 Request processed in 27376us (30135us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1783135634.850783:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 28 00010000:00010000:0.0:1783135634.858515:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.858542:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.858550:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.858556:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135634.858562:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.858570:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.858605:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8e8f1a154900) 00010000:00010000:0.0:1783135634.858608:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135634.858614:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.858620:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de43 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135634.885580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.885741:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792372352 00000100:00100000:0.0:1783135634.885757:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792372352 00000100:00100000:0.0:1783135634.885887:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:0.0:1783135634.885900:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+13:14387:x1869752792372352:12345-192.168.201.60@tcp:101:bash.0 00010000:00010000:0.0:1783135634.885939:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135634.885985:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122d8 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.886100:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.886120:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.886136:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135634.886203:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783135634.886208:0:14125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135634.886230:0:14125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.886242:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.886268:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 15 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.886291:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.886302:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:0.0:1783135634.886304:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135634.886308:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042200, rc 0) 00000100:00100000:0.0:1783135634.886393:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+14:14387:x1869752792372352:12345-192.168.201.60@tcp:101:bash.0 Request processed in 495us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135634.886413:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:2.0:1783135634.890714:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.890801:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792372608 00000100:00100000:0.0:1783135634.890870:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792372608 00000100:00100000:0.0:1783135634.890956:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:0.0:1783135634.890969:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ceb6e8e3-b75e-4201-a568-34429b542814+14:14387:x1869752792372608:12345-192.168.201.60@tcp:35:bash.0 00000100:00100000:0.0:1783135634.891719:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ceb6e8e3-b75e-4201-a568-34429b542814+15:14387:x1869752792372608:12345-192.168.201.60@tcp:35:bash.0 Request processed in 747us (1016us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1783135634.891730:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:2.0:1783135634.971084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135634.971244:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792372864 00000100:00100000:0.0:1783135634.971258:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792372864 00000100:00100000:0.0:1783135634.971380:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 30 00000100:00100000:0.0:1783135634.971393:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+15:14398:x1869752792372864:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135634.971434:0:16058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135634.971458:0:16058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122df expref: -99 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135634.971629:0:16058:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783135634.971783:0:16058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de66 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122df expref: 17 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.971801:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8e8f09ec5200) 00010000:00010000:0.0:1783135634.971804:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783135634.971811:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122df expref: 17 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135634.971868:0:16058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043000, rc 0) 00000100:00100000:0.0:1783135634.971971:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+16:14398:x1869752792372864:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 581us (904us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1783135634.971979:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 30 00000100:00100000:1.0:1783135634.974721:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135634.974868:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792373120 00000100:00100000:3.0:1783135634.974883:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792373120 00000100:00100000:3.0:1783135634.974957:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:3.0:1783135634.974970:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ceb6e8e3-b75e-4201-a568-34429b542814+16:14398:x1869752792373120:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1783135634.975351:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ceb6e8e3-b75e-4201-a568-34429b542814+17:14398:x1869752792373120:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 381us (642us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1783135634.975360:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:3.0:1783135635.014941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135635.015149:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792373376 00000100:00100000:0.0:1783135635.015223:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792373376 00000100:00080000:1.0:1783135635.015337:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783135635.015361:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 31 00000100:00100000:0.0:1783135635.015375:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+17:14401:x1869752792373376:12345-192.168.201.60@tcp:101:lfs.0 00010000:00010000:0.0:1783135635.015409:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135635.015447:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122e6 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.015890:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.015911:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.015925:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135635.015940:0:14125:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135635.016208:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875de74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122e6 expref: 20 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.016238:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122e6 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.016251:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:0.0:1783135635.016254:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135635.016279:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043400, rc 0) 00000100:00100000:0.0:1783135635.016459:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+19:14401:x1869752792373376:12345-192.168.201.60@tcp:101:lfs.0 Request processed in 1085us (1533us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1783135635.016470:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 31 00000100:00100000:2.0:1783135635.021395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135635.021535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135635.021630:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792373632 00000100:00100000:3.0:1783135635.021644:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792373632 00000100:00100000:3.0:1783135635.021734:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:3.0:1783135635.021747:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceb6e8e3-b75e-4201-a568-34429b542814+19:2361:x1869752792373632:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135635.021768:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135635.021803:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875de7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122e6 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.021880:0:14109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:3.0:1783135635.021889:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135635.021971:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceb6e8e3-b75e-4201-a568-34429b542814+18:2361:x1869752792373632:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 226us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135635.021980:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:0.0:1783135635.024362:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792373504 00000100:00100000:0.0:1783135635.024384:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792373504 00000100:00100000:2.0:1783135635.024771:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 32 00000100:00100000:2.0:1783135635.024785:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+18:14401:x1869752792373504:12345-192.168.201.60@tcp:54:lfs.0 00010000:00010000:2.0:1783135635.025087:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025111:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025130:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025243:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025252:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025260:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025267:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2800 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:2.0:1783135635.025272:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025305:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025326:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:2.0:1783135635.025330:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783135635.025336:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.025344:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de89 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135635.025615:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+18:14401:x1869752792373504:12345-192.168.201.60@tcp:54:lfs.0 Request processed in 820us (4225us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135635.025625:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 32 00000100:00100000:2.0:1783135635.029800:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135635.030242:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792373888 00000100:00100000:3.0:1783135635.030256:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792373888 00000100:00100000:3.0:1783135635.030367:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:3.0:1783135635.030381:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c04aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ceb6e8e3-b75e-4201-a568-34429b542814+18:14401:x1869752792373888:12345-192.168.201.60@tcp:35:lfs.0 00000100:00100000:3.0:1783135635.031071:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c04aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ceb6e8e3-b75e-4201-a568-34429b542814+19:14401:x1869752792373888:12345-192.168.201.60@tcp:35:lfs.0 Request processed in 688us (1282us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1783135635.031098:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00000040:00080000:3.0:1783135635.131656:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783135635.408935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135635.409218:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792374144 00000100:00100000:2.0:1783135635.409231:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792374144 00000100:00100000:2.0:1783135635.409300:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:2.0:1783135635.409312:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+19:14432:x1869752792374144:12345-192.168.201.60@tcp:101:cat.0 00010000:00010000:2.0:1783135635.409347:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135635.409375:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de90 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122ed expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.409509:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875de97 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.409527:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875de97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.409563:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875de97 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783135635.409577:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783135635.411124:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2800/0xf646e0cda875de90 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122ed expref: 22 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.411163:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875de97 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122ed expref: 21 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.411175:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:2.0:1783135635.411179:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783135635.411183:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b3800, rc 0) 00000100:00100000:2.0:1783135635.411370:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+21:14432:x1869752792374144:12345-192.168.201.60@tcp:101:cat.0 Request processed in 2057us (2448us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1783135635.411381:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 33 00000100:00100000:2.0:1783135635.420563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135635.420697:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135635.421595:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792374528 00000100:00100000:3.0:1783135635.421626:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792374528 00000100:00100000:3.0:1783135635.421725:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:3.0:1783135635.421745:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceb6e8e3-b75e-4201-a568-34429b542814+21:2361:x1869752792374528:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135635.421767:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135635.421801:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3800/0xf646e0cda875de97 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122ed expref: 21 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.421855:0:14110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:3.0:1783135635.421861:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135635.421955:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceb6e8e3-b75e-4201-a568-34429b542814+20:2361:x1869752792374528:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 213us (1258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135635.421964:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:1.0:1783135635.423657:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792374400 00000100:00100000:1.0:1783135635.423695:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792374400 00000100:00100000:1.0:1783135635.423775:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:1.0:1783135635.423787:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ceb6e8e3-b75e-4201-a568-34429b542814+20:14432:x1869752792374400:12345-192.168.201.60@tcp:35:cat.0 00000100:00100000:1.0:1783135635.424503:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ceb6e8e3-b75e-4201-a568-34429b542814+21:14432:x1869752792374400:12345-192.168.201.60@tcp:35:cat.0 Request processed in 714us (3954us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1783135635.424513:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 8 00000100:00100000:2.0:1783135635.487333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135635.487464:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792374784 00000100:00100000:0.0:1783135635.487478:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792374784 00000100:00100000:0.0:1783135635.487555:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 34 00000100:00100000:0.0:1783135635.487568:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+21:14438:x1869752792374784:12345-192.168.201.60@tcp:101:dd.0 00010000:00010000:0.0:1783135635.487612:0:16058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135635.487643:0:16058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dea5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122f4 expref: -99 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.487874:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.487894:0:16058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 22 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.488135:0:16058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 22 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.488146:0:16058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.488194:0:16058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 22 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.488226:0:16058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 22 pid: 14125 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135635.488244:0:16058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3c3dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16058:1869752813332736:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135635.488502:0:16058:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 22 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.488513:0:16058:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 22 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135635.488524:0:16058:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e026e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16058:1869752813332864:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135635.488552:0:16058:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783135635.491433:0:16058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3c3dc380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16058:1869752813332736:192.168.201.60@tcp:104: 00000100:00100000:0.0:1783135635.491453:0:16058:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e026e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16058:1869752813332864:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135635.491496:0:16058:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135635.491506:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135635.491544:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135635.491655:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792374912 00000100:00100000:3.0:1783135635.491665:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792374912 00010000:00010000:3.0:1783135635.491712:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 23 pid: 14125 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135635.491754:0:14110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792375040 00000100:00100000:3.0:1783135635.491757:0:14110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792375040 00010000:00010000:3.0:1783135635.491767:0:14110:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 24 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135635.491779:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:3.0:1783135635.491786:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f338b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceb6e8e3-b75e-4201-a568-34429b542814+24:2361:x1869752792374912:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135635.491898:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135635.491908:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 24 pid: 14125 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.491922:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 24 pid: 14125 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.491949:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042200/0xf646e0cda875de5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d8 expref: 24 pid: 14125 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.491970:0:14110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:3.0:1783135635.491976:0:14110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.491986:0:14110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.491993:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135635.492058:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f338b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceb6e8e3-b75e-4201-a568-34429b542814+23:2361:x1869752792374912:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 271us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135635.492067:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:3.0:1783135635.492124:0:14110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:3.0:1783135635.492131:0:14110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceb6e8e3-b75e-4201-a568-34429b542814+22:2361:x1869752792375040:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135635.492140:0:14110:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135635.492155:0:14110:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 22 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.492178:0:14110:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 22 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.492192:0:14110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042600/0xf646e0cda875de4a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122d1 expref: 22 pid: 14124 timeout: 634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.492203:0:14110:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:3.0:1783135635.492207:0:14110:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.492216:0:14110:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.492225:0:14110:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.492250:0:14110:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135635.492267:0:14110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ceb6e8e3-b75e-4201-a568-34429b542814+21:2361:x1869752792375040:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 137us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135635.492272:0:14110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 12 00010000:00010000:0.0:1783135635.492341:0:16058:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.492352:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135635.492377:0:16058:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1783135635.492596:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dea5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122f4 expref: 22 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.492681:0:16058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043800/0xf646e0cda875deac lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122f4 expref: 21 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.492691:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:0.0:1783135635.492695:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783135635.492698:0:16058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043800, rc 0) 00000100:00100000:0.0:1783135635.492730:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+21:14438:x1869752792374784:12345-192.168.201.60@tcp:101:dd.0 Request processed in 5166us (5416us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1783135635.492739:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 34 00000100:00100000:1.0:1783135635.502520:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135635.502590:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792375296 00000100:00100000:0.0:1783135635.502614:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792375296 00000100:00100000:0.0:1783135635.502694:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 35 00000100:00100000:0.0:1783135635.502706:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+21:14438:x1869752792375296:12345-192.168.201.60@tcp:36:dd.0 00010000:00010000:0.0:1783135635.503266:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.503295:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135635.503310:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135635.503378:0:14125:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1783135635.503448:0:14125:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b53a6ae1 reply state 000000002a4e10b1 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135635.503458:0:14125:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135635.503768:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+24:14438:x1869752792375296:12345-192.168.201.60@tcp:36:dd.0 Request processed in 1059us (1256us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1783135635.503777:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 35 00000020:00080000:0.0:1783135635.503785:0:14125:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1783135635.512693:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00010000:00010000:3.0:1783135635.512797:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.512813:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.512920:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135635.513762:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792375424 00000100:00100000:2.0:1783135635.513777:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792375424 00000100:00100000:2.0:1783135635.513970:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 36 00000100:00100000:2.0:1783135635.513984:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+24:14438:x1869752792375424:12345-192.168.201.60@tcp:101:dd.0 00010000:00010000:2.0:1783135635.514027:0:14124:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135635.514052:0:14124:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875dec1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab122fb expref: -99 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.514163:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875dec1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122fb expref: 25 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.514182:0:14124:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875dec1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122fb expref: 25 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.514209:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:2.0:1783135635.514213:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135635.514218:0:14124:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2c00, rc 0) 00000100:00100000:2.0:1783135635.514308:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+25:14438:x1869752792375424:12345-192.168.201.60@tcp:101:dd.0 Request processed in 325us (1629us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135635.514318:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 36 00010000:00010000:3.0:1783135635.515273:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135635.515281:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.515292:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.515313:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:3.0:1783135635.515316:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135635.515322:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.515331:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875deba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135635.568123:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135635.572273:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792375680 00000100:00100000:3.0:1783135635.572297:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792375680 00000100:00100000:3.0:1783135635.572474:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:3.0:1783135635.572487:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ceb6e8e3-b75e-4201-a568-34429b542814+24:14438:x1869752792375680:12345-192.168.201.60@tcp:103:dd.0 00010000:00010000:3.0:1783135635.572509:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135635.572544:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2c00/0xf646e0cda875dec1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab122fb expref: 24 pid: 14124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.572571:0:14108:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:3.0:1783135635.572578:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135635.572666:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ceb6e8e3-b75e-4201-a568-34429b542814+23:14438:x1869752792375680:12345-192.168.201.60@tcp:103:dd.0 Request processed in 181us (4556us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135635.572675:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:2.0:1783135635.579351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135635.580360:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792375808 00000100:00100000:3.0:1783135635.580377:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792375808 00000100:00100000:3.0:1783135635.580459:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00100000:3.0:1783135635.580470:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+23:14438:x1869752792375808:12345-192.168.201.60@tcp:58:dd.0 00010000:00010000:3.0:1783135635.580610:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.580633:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135635.580647:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783135635.588592:0:14123:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783135635.588783:0:14123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1783135635.591635:0:14123:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1783135635.591918:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+23:14438:x1869752792375808:12345-192.168.201.60@tcp:58:dd.0 Request processed in 11439us (12576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135635.591942:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 37 00000100:00100000:0.0:1783135635.614487:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135635.614859:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792375936 00000100:00100000:2.0:1783135635.614876:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792375936 00000100:00100000:2.0:1783135635.614963:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 38 00000100:00100000:2.0:1783135635.614975:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e026e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+23:14438:x1869752792375936:12345-192.168.201.60@tcp:101:dd.0 00010000:00010000:2.0:1783135635.615123:0:16058:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783135635.615221:0:16058:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875decf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12302 expref: -99 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.615304:0:16058:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.615316:0:16058:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875decf lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12302 expref: 24 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.615358:0:16058:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.615373:0:16058:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875decf lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12302 expref: 24 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.615389:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:2.0:1783135635.615392:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783135635.615396:0:16058:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875decf lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12302 expref: 24 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135635.615405:0:16058:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f123b2400, rc 0) 00000100:00100000:2.0:1783135635.616493:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e026e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+24:14438:x1869752792375936:12345-192.168.201.60@tcp:101:dd.0 Request processed in 1510us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135635.616508:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 38 00010000:00010000:1.0:1783135635.650572:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783135636.155298:0:14154:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783135636.155312:0:14154:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783135636.155377:0:14154:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783135636.155386:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783135636.155567:0:14154:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14154:1869752813332992:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135636.155703:0:14154:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09f309c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135636.167694:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.167801:0:14134:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792376064 00000100:00100000:3.0:1783135636.167853:0:14134:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792376064 00000100:00100000:3.0:1783135636.167909:0:14134:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:3.0:1783135636.167919:0:14134:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ceb6e8e3-b75e-4201-a568-34429b542814+25:14439:x1869752792376064:12345-192.168.201.60@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1783135636.168107:0:14134:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ceb6e8e3-b75e-4201-a568-34429b542814+25:14439:x1869752792376064:12345-192.168.201.60@tcp:900:lhsmtool_posix.0 Request processed in 189us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135636.168117:0:14134:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:1.0:1783135636.168528:0:14154:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3fcb4000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14154:1869752813332992:192.168.201.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783135636.181869:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.181978:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792376192 00000100:00100000:0.0:1783135636.181998:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792376192 00000100:00100000:0.0:1783135636.182095:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:0.0:1783135636.182109:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+24:14439:x1869752792376192:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135636.182160:0:14125:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135636.182313:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+24:14439:x1869752792376192:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 206us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135636.182322:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 39 00000100:00100000:3.0:1783135636.193803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.194934:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792376320 00000100:00100000:0.0:1783135636.194946:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792376320 00000100:00100000:0.0:1783135636.195007:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 40 00000100:00100000:0.0:1783135636.195018:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+24:14439:x1869752792376320:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1783135636.195099:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195116:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195129:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195280:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195306:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195314:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195340:0:14124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195348:0:14124:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195354:0:14124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135636.195465:0:14124:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1783135636.195470:0:14124:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135636.195484:0:14124:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195496:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195503:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195510:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195517:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135636.195521:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195534:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195547:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f1a154300) 00010000:00010000:0.0:1783135636.195550:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135636.195554:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195559:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875ded6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195573:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195578:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195584:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195588:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135636.195590:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195596:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195603:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8e8f1a154900) 00010000:00010000:0.0:1783135636.195606:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135636.195608:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195622:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875dedd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195637:0:14124:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195643:0:14124:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195648:0:14124:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195653:0:14124:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135636.195656:0:14124:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195661:0:14124:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195668:0:14124:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:0.0:1783135636.195670:0:14124:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135636.195672:0:14124:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.195677:0:14124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875dee4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14124 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135636.197056:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+24:14439:x1869752792376320:12345-192.168.201.60@tcp:34:lhsmtool_posix.0 Request processed in 2029us (3256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135636.197072:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 40 00000100:00100000:2.0:1783135636.204169:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.204619:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792376576 00000100:00100000:1.0:1783135636.204629:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792376576 00000100:00100000:1.0:1783135636.204690:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:1.0:1783135636.204700:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+24:14439:x1869752792376576:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135636.204720:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135636.204739:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875deeb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12309 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.204861:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.204876:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.204896:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783135636.204927:0:14123:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1783135636.206375:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.206391:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.206398:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.206404:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f0121c600 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135636.206409:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.206417:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.206432:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:1.0:1783135636.206435:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1783135636.206440:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.206447:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875def2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783135636.207034:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:0.0:1783135636.207058:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:1.0:1783135636.207559:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875deeb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12309 expref: 13 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.207573:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8e8f1a154300) 00010000:00010000:1.0:1783135636.207576:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783135636.207593:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121d400/0xf646e0cda875deeb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12309 expref: 13 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.207606:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d400, rc 0) 00000100:00100000:1.0:1783135636.207677:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+12:14439:x1869752792376576:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 2977us (3518us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1783135636.207687:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 41 00000100:00100000:2.0:1783135636.222688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.222774:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792376704 00000100:00100000:0.0:1783135636.222783:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792376704 00000100:00100000:0.0:1783135636.222885:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:0.0:1783135636.222897:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+12:14439:x1869752792376704:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783135636.222955:0:16058:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783135636.223068:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+12:14439:x1869752792376704:12345-192.168.201.60@tcp:53:lhsmtool_posix.0 Request processed in 173us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135636.223076:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 42 00000100:00100000:3.0:1783135636.225905:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.226016:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792376960 00000100:00100000:0.0:1783135636.226026:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792376960 00000100:00100000:0.0:1783135636.226166:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:0.0:1783135636.226177:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+12:14439:x1869752792376960:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135636.226198:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135636.226220:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df00 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12310 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783135636.226993:0:14125:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1783135636.227003:0:14125:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1783135636.227043:0:14125:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1783135636.227266:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df07 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.227278:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.227286:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df07 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.227338:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df00 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12310 expref: 15 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.227352:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df07 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12310 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.227358:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f1a154900) 00010000:00010000:0.0:1783135636.227360:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783135636.227362:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d042c00, rc 0) 00000100:00100000:0.0:1783135636.227411:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+14:14439:x1869752792376960:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 1237us (1517us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1783135636.227416:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 43 00000100:00100000:1.0:1783135636.230703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.230772:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792377216 00000100:00100000:0.0:1783135636.230779:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792377216 00000100:00100000:0.0:1783135636.230860:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:0.0:1783135636.230871:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+14:14439:x1869752792377216:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135636.230952:0:16058:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135636.230985:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12310 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231008:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f1a154900) 00010000:00010000:0.0:1783135636.231020:0:16058:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135636.231048:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231062:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231088:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231101:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231106:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231111:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231368:0:16058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231375:0:16058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231382:0:16058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231387:0:16058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043400 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135636.231392:0:16058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231400:0:16058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231409:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8e8f1a154700) 00010000:00010000:0.0:1783135636.231412:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135636.231416:0:16058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231426:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043400/0xf646e0cda875df15 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231433:0:16058:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231437:0:16058:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231441:0:16058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231443:0:16058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135636.231445:0:16058:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231448:0:16058:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231452:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x6a3668b3 (ffff8e8f1a154f00) 00010000:00010000:0.0:1783135636.231454:0:16058:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783135636.231455:0:16058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.231458:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df1c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x6a3668b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135636.231544:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+13:14439:x1869752792377216:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 674us (850us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783135636.231551:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 44 00000100:00100000:3.0:1783135636.233353:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.233438:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792377344 00000100:00100000:1.0:1783135636.233446:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792377344 00000100:00100000:1.0:1783135636.233492:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:1.0:1783135636.233501:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+13:14439:x1869752792377344:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135636.233522:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135636.233546:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df23 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12317 expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.233575:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875df2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.233583:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875df2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.233591:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875df2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.233683:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12317 expref: 15 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.233696:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121cc00/0xf646e0cda875df2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12317 expref: 14 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.233707:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:1.0:1783135636.233709:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135636.233711:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121cc00, rc 0) 00000100:00100000:1.0:1783135636.233791:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+14:14439:x1869752792377344:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 291us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135636.233796:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 45 00000100:00100000:3.0:1783135636.236509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.236904:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792377600 00000100:00100000:0.0:1783135636.236915:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792377600 00000100:00100000:0.0:1783135636.237040:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 46 00000100:00100000:0.0:1783135636.237054:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+14:14439:x1869752792377600:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135636.237190:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.237203:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.237212:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783135636.237685:0:16058:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1783135636.237694:0:16058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 535666877748ns, next at 536666876143ns, rc = 0 00000004:00010000:0.0:1783135636.237770:0:16058:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003992feda reply state 00000000333eb70f transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135636.237777:0:16058:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135636.238059:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+16:14439:x1869752792377600:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 1005us (1556us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1783135636.238069:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 46 00010000:00010000:0.0:1783135636.243101:0:3298:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.243118:0:3298:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.243126:0:3298:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.243208:0:3298:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043200 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:0.0:1783135636.243213:0:3298:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.243221:0:3298:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.243243:0:3298:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:0.0:1783135636.243246:0:3298:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783135636.243250:0:3298:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.243256:0:3298:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df31 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.244430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.244739:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792377728 00000100:00100000:1.0:1783135636.244747:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792377728 00000100:00100000:1.0:1783135636.244792:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:1.0:1783135636.244802:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+15:14439:x1869752792377728:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135636.244864:0:14123:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135636.244898:0:14123:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1231e expref: -99 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.244984:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 16 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.244998:0:14123:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 16 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.245019:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:1.0:1783135636.245023:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135636.245026:0:14123:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121c600, rc 0) 00000100:00100000:1.0:1783135636.245094:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fcb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+16:14439:x1869752792377728:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 293us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135636.245119:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 47 00000100:00100000:3.0:1783135636.247304:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.247348:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792377856 00000100:00100000:0.0:1783135636.247357:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792377856 00000100:00100000:0.0:1783135636.247481:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00080000:1.0:1783135636.247552:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135636.247592:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792377856:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783135636.247929:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+6:2360:x1869752792377856:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 339us (631us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783135636.248066:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 12 00000100:00100000:3.0:1783135636.249895:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.250026:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792378112 00000100:00100000:1.0:1783135636.250034:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792378112 00000100:00100000:1.0:1783135636.250077:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:1.0:1783135636.250084:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ceb6e8e3-b75e-4201-a568-34429b542814+16:14439:x1869752792378112:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783135636.250312:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ceb6e8e3-b75e-4201-a568-34429b542814+17:14439:x1869752792378112:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 226us (425us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1783135636.250320:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 9 00000100:00100000:3.0:1783135636.252038:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135636.252099:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792378368 00000100:00100000:2.0:1783135636.252110:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792378368 00000100:00100000:2.0:1783135636.252220:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:2.0:1783135636.252232:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+17:14439:x1869752792378368:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135636.252339:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+17:14439:x1869752792378368:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 109us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135636.252347:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 48 00000100:00100000:2.0:1783135636.254082:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.254144:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792378496 00000100:00100000:0.0:1783135636.254151:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792378496 00000100:00100000:0.0:1783135636.254208:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:0.0:1783135636.254217:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+17:14439:x1869752792378496:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783135636.254234:0:14125:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783135636.254258:0:14125:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12325 expref: -99 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.254330:0:14125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df46 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.254343:0:14125:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.254354:0:14125:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783135636.254402:0:14125:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783135636.254420:0:14125:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df46 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14125 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.254440:0:14125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043200/0xf646e0cda875df3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12325 expref: 19 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.254453:0:14125:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df46 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12325 expref: 18 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.254459:0:14125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:0.0:1783135636.254461:0:14125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1783135636.254464:0:14125:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f3d043000, rc 0) 00000100:00100000:0.0:1783135636.254515:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+18:14439:x1869752792378496:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 299us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135636.254521:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 49 00000100:00100000:0.0:1783135636.256736:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.256837:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792378624 00000100:00100000:3.0:1783135636.256847:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792378624 00000100:00100000:3.0:1783135636.256907:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:3.0:1783135636.256915:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+6:2360:x1869752792378624:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783135636.257029:0:14760:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783135636.257050:0:14760:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab1232c expref: -99 pid: 14760 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135636.257076:0:14760:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a487d94, blocks: 0x1 00010000:00010000:3.0:1783135636.257093:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=535s v=(0 0) 00010000:00010000:3.0:1783135636.257096:0:14760:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135636.257103:0:14760:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 7 pid: 14760 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.257155:0:14760:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 7 pid: 14760 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.257172:0:14760:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f02c38e00, rc 0) 00000100:00100000:3.0:1783135636.257231:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+7:2360:x1869752792378624:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 317us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135636.257236:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:3.0:1783135636.259441:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135636.259516:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792378880 00000100:00100000:2.0:1783135636.259526:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792378880 00000100:00100000:2.0:1783135636.259579:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 50 00000100:00100000:2.0:1783135636.259589:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+18:14439:x1869752792378880:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783135636.259698:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ceb6e8e3-b75e-4201-a568-34429b542814+18:14439:x1869752792378880:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 109us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135636.259706:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 50 00000100:00100000:2.0:1783135636.261796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.261868:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792379008 00000100:00100000:0.0:1783135636.261896:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792379008 00000100:00100000:0.0:1783135636.261953:0:14125:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 51 00000100:00100000:0.0:1783135636.261977:0:14125:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+18:14439:x1869752792379008:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1783135636.294570:0:14125:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ceb6e8e3-b75e-4201-a568-34429b542814+18:14439:x1869752792379008:12345-192.168.201.60@tcp:44:lhsmtool_posix.0 Request processed in 32584us (32769us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135636.294582:0:14125:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 51 00000001:00080000:1.0:1783135636.295111:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:1.0:1783135636.295232:0:5817:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1783135636.295263:0:5817:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1783135636.295856:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783135636.295877:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813333120:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1783135636.295943:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135636.296293:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813333120 00000100:00100000:3.0:1783135636.296302:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813333120 00000100:00100000:0.0:1783135636.296463:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783135636.296476:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f37b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869752813333120:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1783135636.296735:0:14761:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1783135636.296739:0:14761:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1783135636.296742:0:14761:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1783135636.296744:0:14761:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783135636 -> 1783135636 00002000:00010000:0.0:1783135636.296746:0:14761:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1783135636.296794:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f37b80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1869752813333120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 321us (851us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1783135636.296802:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1783135636.296950:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1783135636.297051:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8e8f3db05c00/2, rc 0, transno 8589934595 00000100:00100000:1.0:1783135636.297058:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3312:1869752813333120:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1783135636.297910:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135636.298053:0:15725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792379136 00000100:00100000:2.0:1783135636.298062:0:15725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792379136 00000100:00100000:2.0:1783135636.298196:0:15725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:2.0:1783135636.298207:0:15725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3c3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ceb6e8e3-b75e-4201-a568-34429b542814+7:2361:x1869752792379136:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783135636.298323:0:15725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3c3dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ceb6e8e3-b75e-4201-a568-34429b542814+7:2361:x1869752792379136:12345-192.168.201.60@tcp:16:lhsmtool_posix.0 Request processed in 118us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135636.298332:0:15725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:3.0:1783135636.301409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135636.301612:0:16058:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792379392 00000100:00100000:0.0:1783135636.301621:0:16058:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792379392 00000100:00100000:0.0:1783135636.301754:0:16058:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 52 00000100:00100000:0.0:1783135636.301764:0:16058:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+14:14439:x1869752792379392:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783135636.302097:0:16058:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783135636.302246:0:16058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d043000/0xf646e0cda875df46 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12325 expref: 14 pid: 14125 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.302268:0:16058:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:0.0:1783135636.302288:0:16058:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783135636.302319:0:16058:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.302332:0:16058:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.302342:0:16058:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783135636.302869:0:16058:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0747aa6 reply state 00000000492da269 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135636.302881:0:16058:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783135636.303106:0:16058:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ceb6e8e3-b75e-4201-a568-34429b542814+15:14439:x1869752792379392:12345-192.168.201.60@tcp:36:lhsmtool_posix.0 Request processed in 1342us (1705us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1783135636.303123:0:16058:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 52 00000100:00100000:0.0:1783135636.307178:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.307324:0:14761:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792379520 00000100:00100000:1.0:1783135636.307340:0:14761:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792379520 00000100:00100000:1.0:1783135636.307402:0:14761:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:1.0:1783135636.307413:0:14761:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+7:14439:x1869752792379520:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783135636.307429:0:14761:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783135636.307448:0:14761:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x802f2c1b8ab12333 expref: -99 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.307510:0:14761:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 8 pid: 14760 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.307520:0:14761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135636.307524:0:14761:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135636.307530:0:14761:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 8 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.307564:0:14761:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 8 pid: 14760 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.307579:0:14761:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 8 pid: 14760 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.307595:0:14761:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14761:1869752813333248:192.168.201.60@tcp:104: 00000100:00100000:1.0:1783135636.307698:0:14761:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200540 going to sleep for 11 seconds 00010000:00010000:3.0:1783135636.308751:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.308766:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.308772:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.308779:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:3.0:1783135636.308784:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.308793:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.308810:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:3.0:1783135636.308851:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783135636.308857:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.308863:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16058 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.315555:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.315700:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792379648 00000100:00100000:3.0:1783135636.315710:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792379648 00010000:00010000:3.0:1783135636.315755:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 9 pid: 14760 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.315800:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:3.0:1783135636.315810:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceb6e8e3-b75e-4201-a568-34429b542814+9:2360:x1869752792379648:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135636.315871:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135636.315893:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 9 pid: 14760 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.315907:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 9 pid: 14760 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.315931:0:14109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135636.315935:0:14109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135636.315944:0:14109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 9 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.316265:0:14109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 9 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.316326:0:14109:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 9 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.316341:0:14109:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14109:1869752813333376:192.168.201.60@tcp:105: 00000100:00100000:3.0:1783135636.316423:0:14109:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f3bf739c0 going to sleep for 11 seconds 00010000:00010000:0.0:1783135636.317271:0:14761:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7594fae/0xf646e0cda875df4d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1232c expref: 9 pid: 14760 timeout: 635 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783135636.317289:0:14761:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:14761:1869752813333248:192.168.201.60@tcp:104: 00010000:00010000:0.0:1783135636.317314:0:14761:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 8 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.317326:0:14761:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8e8f0121d400, rc 0) 00000100:00100000:0.0:1783135636.317418:0:14761:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ceb6e8e3-b75e-4201-a568-34429b542814+8:14439:x1869752792379520:12345-192.168.201.60@tcp:101:lhsmtool_posix.0 Request processed in 10007us (10249us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135636.317439:0:14761:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 16 00000100:00100000:0.0:1783135636.319655:0:14109:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db04380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14109:1869752813333376:192.168.201.60@tcp:105: 00010000:00010000:0.0:1783135636.319754:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783135636.319873:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceb6e8e3-b75e-4201-a568-34429b542814+7:2360:x1869752792379648:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 4062us (4326us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135636.319883:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 13 00000100:00100000:3.0:1783135636.322469:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135636.322626:0:15725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792379776 00000100:00100000:2.0:1783135636.322636:0:15725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792379776 00000100:00100000:2.0:1783135636.322788:0:15725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:2.0:1783135636.322799:0:15725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ceb6e8e3-b75e-4201-a568-34429b542814+7:2360:x1869752792379776:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783135636.323073:0:15725:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783135636.323077:0:15725:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783135635 00002000:00010000:2.0:1783135636.323079:0:15725:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783135634 00002000:00010000:2.0:1783135636.323081:0:15725:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783135636 -> 1783135635 00002000:00010000:2.0:1783135636.323083:0:15725:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783135636.323158:0:15725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ceb6e8e3-b75e-4201-a568-34429b542814+8:2360:x1869752792379776:12345-192.168.201.60@tcp:2:lhsmtool_posix.0 Request processed in 361us (695us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783135636.323183:0:15725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 17 00000100:00100000:1.0:1783135636.328076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135636.328186:0:14762:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792379904 00000100:00100000:2.0:1783135636.328197:0:14762:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792379904 00000100:00100000:2.0:1783135636.328257:0:14762:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:2.0:1783135636.328268:0:14762:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ceb6e8e3-b75e-4201-a568-34429b542814+8:2361:x1869752792379904:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783135636.328333:0:14762:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.328354:0:14762:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 8 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.328363:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135636.328659:0:14762:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783135636.328663:0:14762:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.328809:0:14762:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 8 pid: 14761 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.328859:0:14762:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 8 pid: 14761 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135636.328875:0:14762:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14762:1869752813333504:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135636.329055:0:14762:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f093569c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783135636.332245:0:14762:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c62300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14762:1869752813333504:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135636.332302:0:14762:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.332632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.333418:0:14108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792380032 00000100:00100000:3.0:1783135636.333428:0:14108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792380032 00010000:00010000:3.0:1783135636.333463:0:14108:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 9 pid: 14761 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.333509:0:14108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:3.0:1783135636.333518:0:14108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ceb6e8e3-b75e-4201-a568-34429b542814+9:2361:x1869752792380032:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135636.333534:0:14108:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135636.333554:0:14108:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 9 pid: 14761 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.333571:0:14108:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 9 pid: 14761 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.333590:0:14108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a6205df/0xf646e0cda875df5b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12333 expref: 9 pid: 14761 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.333609:0:14108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135636.333621:0:14108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783135636.333626:0:14108:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.333633:0:14108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.333653:0:14108:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783135636.333677:0:14762:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.333686:0:14762:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.333778:0:14762:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.333788:0:14762:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.333796:0:14762:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.333802:0:14762:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2800 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135636.333807:0:14762:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.333900:0:14762:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.333913:0:14762:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.333936:0:14762:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000351cd24e/0xf646e0cda875df62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14762 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.334001:0:14108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ceb6e8e3-b75e-4201-a568-34429b542814+8:2361:x1869752792380032:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 482us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135636.334009:0:14108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 14 00000100:00100000:2.0:1783135636.334205:0:14762:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ceb6e8e3-b75e-4201-a568-34429b542814+7:2361:x1869752792379904:12345-192.168.201.60@tcp:1:lhsmtool_posix.0 Request processed in 5939us (6143us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135636.334214:0:14762:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 18 00000100:00100000:1.0:1783135636.337759:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.338249:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792380288 00000100:00100000:3.0:1783135636.338258:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792380288 00000100:00100000:3.0:1783135636.338323:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 53 00000100:00100000:3.0:1783135636.338334:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+14:14439:x1869752792380288:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783135636.338562:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.338580:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.338592:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.340612:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.340641:0:14123:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 15 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.340650:0:14123:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.341054:0:14123:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 15 pid: 14123 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.341075:0:14123:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 15 pid: 14123 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135636.341093:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f02c62300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869752813333632:192.168.201.60@tcp:104: 00000100:00100000:2.0:1783135636.341572:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f09356900 going to sleep for 11 seconds 00000100:00100000:0.0:1783135636.348881:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:2.0:1783135636.349123:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f02c62300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869752813333632:192.168.201.60@tcp:104: 00010000:00010000:2.0:1783135636.349152:0:14123:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.349352:0:14109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792380416 00000100:00100000:3.0:1783135636.349358:0:14109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792380416 00010000:00010000:3.0:1783135636.349436:0:14109:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 16 pid: 14123 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.349557:0:14109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 15 00000100:00100000:3.0:1783135636.349567:0:14109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceb6e8e3-b75e-4201-a568-34429b542814+16:2361:x1869752792380416:12345-192.168.201.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783135636.349581:0:14109:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783135636.349588:0:14109:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 16 pid: 14123 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.349600:0:14109:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 16 pid: 14123 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.349623:0:14109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f0121c600/0xf646e0cda875df38 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab1231e expref: 16 pid: 14123 timeout: 635 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.349639:0:14109:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:3.0:1783135636.349644:0:14109:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.349654:0:14109:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.349661:0:14109:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.349689:0:14109:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783135636.349753:0:14109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ceb6e8e3-b75e-4201-a568-34429b542814+15:2361:x1869752792380416:12345-192.168.201.60@tcp:103:ldlm_bl.0 Request processed in 186us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135636.349768:0:14109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 15 00010000:00010000:1.0:1783135636.349843:0:14123:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.349851:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783135636.350053:0:14123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1783135636.350423:0:14123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1783135636.350456:0:14123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1783135636.350523:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14123:1869752813333760:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783135636.350605:0:14123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135636.350634:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200540 going to sleep for 11 seconds 00000100:00100000:2.0:1783135636.353290:0:14128:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813333760 00000100:00100000:2.0:1783135636.353316:0:14128:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813333760 00000100:00100000:2.0:1783135636.353392:0:14128:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783135636.353404:0:14128:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14123:x1869752813333760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783135636.354904:0:14128:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14123:x1869752813333760:12345-0@lo:1000:mdt00_000.0 Request processed in 1492us (4288us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135636.355103:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8e03331f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14123:1869752813333760:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783135636.356463:0:14128:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1783135636.357268:0:14123:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1783135636.357382:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14123:1869752813333888:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783135636.357456:0:14123:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135636.357493:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f08262cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783135636.357609:0:14129:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813333888 00000100:00100000:0.0:1783135636.357617:0:14129:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813333888 00000100:00100000:0.0:1783135636.357673:0:14129:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783135636.357682:0:14129:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14123:x1869752813333888:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1783135636.358311:0:14129:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14123:x1869752813333888:12345-0@lo:1000:mdt00_000.0 Request processed in 627us (851us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1783135636.358320:0:14129:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783135636.358333:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14123:1869752813333888:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1783135636.358374:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358386:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358394:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358401:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3000 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135636.358405:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358413:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358445:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:1.0:1783135636.358448:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135636.358452:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358459:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b3000/0xf646e0cda875df70 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358492:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358499:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358504:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358509:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39e00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135636.358512:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358517:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358526:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:1.0:1783135636.358529:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783135636.358535:0:14123:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875decf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12302 expref: 18 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358547:0:14123:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875decf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12302 expref: 18 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358616:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875decf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12302 expref: 18 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.358644:0:14123:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f123b2400/0xf646e0cda875decf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.60@tcp remote: 0x802f2c1b8ab12302 expref: 18 pid: 16058 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.358653:0:14123:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869752813334016:192.168.201.60@tcp:105: 00000100:00100000:1.0:1783135636.359140:0:14123:0:(client.c:2701:ptlrpc_set_wait()) set ffff8e8f05200b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783135636.364497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.364647:0:14126:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792380544 00000100:00100000:3.0:1783135636.364672:0:14126:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792380544 00000100:00100000:3.0:1783135636.364776:0:14126:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:3.0:1783135636.364787:0:14126:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fc6a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ceb6e8e3-b75e-4201-a568-34429b542814+19:14438:x1869752792380544:12345-192.168.201.60@tcp:49:dd.0 00000100:00100000:3.0:1783135636.365174:0:14126:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fc6a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ceb6e8e3-b75e-4201-a568-34429b542814+19:14438:x1869752792380544:12345-192.168.201.60@tcp:49:dd.0 Request processed in 387us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135636.365183:0:14126:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 10 00000100:00100000:1.0:1783135636.365710:0:14123:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14123:1869752813334016:192.168.201.60@tcp:105: 00010000:00010000:1.0:1783135636.365743:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.365755:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c39e00/0xf646e0cda875dec8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.365804:0:14123:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.365855:0:14123:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.365868:0:14123:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.365880:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.365886:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.365905:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.365910:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135636.365914:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366095:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366110:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:1.0:1783135636.366113:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783135636.366117:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366123:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3c486c00/0xf646e0cda875df77 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366141:0:14123:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366147:0:14123:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366152:0:14123:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366156:0:14123:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38c00 already unused, calling callback (ffffffffc21214f0) 00010000:00010000:1.0:1783135636.366159:0:14123:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366174:0:14123:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366183:0:14123:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8e8f1a154100) 00010000:00010000:1.0:1783135636.366186:0:14123:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783135636.366188:0:14123:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.366193:0:14123:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f02c38c00/0xf646e0cda875df69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14123 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783135636.366528:0:14154:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783135636.366535:0:14154:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783135636.366632:0:14154:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1783135636.366640:0:14154:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1783135636.366731:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+18:14439:x1869752792380288:12345-192.168.201.60@tcp:57:lhsmtool_posix.0 Request processed in 28395us (28980us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1783135636.366741:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 53 00000020:00080000:1.0:1783135636.366747:0:14123:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1783135636.376239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.376336:0:14127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792380800 00000100:00100000:3.0:1783135636.376347:0:14127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792380800 00000100:00100000:3.0:1783135636.376406:0:14127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 11 00000100:00100000:3.0:1783135636.376417:0:14127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ceb6e8e3-b75e-4201-a568-34429b542814+18:14439:x1869752792380800:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783135636.377503:0:14127:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783135636.377727:0:14127:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1783135636.377925:0:14127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.377944:0:14127:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.377958:0:14127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.377968:0:14127:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.377983:0:14127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.377989:0:14127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.378065:0:14127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783135636.378174:0:14127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ceb6e8e3-b75e-4201-a568-34429b542814+20:14439:x1869752792380800:12345-192.168.201.60@tcp:35:lhsmtool_posix.0 Request processed in 1755us (1941us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1783135636.378184:0:14127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 11 00000020:00080000:0.0:1783135636.378190:0:14127:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783135636.379488:0:14112:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783135636.379500:0:14112:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.379511:0:14112:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d042c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135636.379515:0:14112:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.379523:0:14112:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.379559:0:14112:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8e8f03a45600) 00010000:00010000:1.0:1783135636.379632:0:14112:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783135636.379638:0:14112:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.379645:0:14112:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8e8f3d042c00/0xf646e0cda875df7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14127 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.379661:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135636.379663:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135636.379665:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783135636.601746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.602037:0:14765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792380928 00000100:00100000:3.0:1783135636.602048:0:14765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792380928 00000100:00100000:3.0:1783135636.602124:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:3.0:1783135636.602134:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ceb6e8e3-b75e-4201-a568-34429b542814+7:2361:x1869752792380928:12345-192.168.201.60@tcp:4:dd.0 00002000:00010000:3.0:1783135636.602184:0:14765:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a487d93, atime: 0x6a487d92, ctime: 0x6a487d93, blocks: 0x1 00010000:00010000:3.0:1783135636.602194:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.602209:0:14765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=536s v=(0 0) 00010000:00010000:3.0:1783135636.602213:0:14765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135636.602219:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.602235:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.610582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.610634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.610672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.610703:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.610980:0:14767:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783135636.610991:0:14767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1783135636.611224:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783135636.611241:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792381056 00000100:00100000:2.0:1783135636.611251:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792381056 00000100:00100000:2.0:1783135636.611310:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783135636.611316:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792381312 00000100:00100000:2.0:1783135636.611318:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792381312 00000100:00100000:2.0:1783135636.611334:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783135636.611339:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792381568 00000100:00100000:2.0:1783135636.611342:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792381568 00000100:00100000:2.0:1783135636.611354:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783135636.611358:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792381824 00000100:00100000:2.0:1783135636.611360:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792381824 00000100:00100000:2.0:1783135636.612572:0:16254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:2.0:1783135636.612588:0:16254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ceb6e8e3-b75e-4201-a568-34429b542814+12:2361:x1869752792381056:12345-192.168.201.60@tcp:4:dd.0 00010000:00010000:2.0:1783135636.612985:0:16254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.613003:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135636.613008:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135636.613014:0:16254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.613044:0:16254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.620243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.620283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:1.0:1783135636.620401:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:3.0:1783135636.625437:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1783135636.628995:0:14767:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1783135636.629412:0:14766:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1783135636.630201:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792381184 00000100:00100000:3.0:1783135636.630212:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792381184 00000100:00100000:3.0:1783135636.630272:0:14766:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1783135636.630280:0:14766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792381440 00000100:00100000:3.0:1783135636.630283:0:14766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792381440 00000100:00100000:0.0:1783135636.631573:0:16255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792381696 00000100:00100000:0.0:1783135636.631585:0:16255:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792381696 00000100:00100000:0.0:1783135636.631634:0:16255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:0.0:1783135636.631644:0:16255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ceb6e8e3-b75e-4201-a568-34429b542814+15:2360:x1869752792381312:12345-192.168.201.60@tcp:4:dd.0 00010000:00010000:0.0:1783135636.631684:0:16255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.631801:0:16255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135636.631805:0:16255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783135636.631844:0:16255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783135636.631861:0:16255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135636.638553:0:14767:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1783135636.639956:0:16256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:2.0:1783135636.639974:0:16256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ceb6e8e3-b75e-4201-a568-34429b542814+17:2360:x1869752792381568:12345-192.168.201.60@tcp:4:dd.0 00010000:00010000:2.0:1783135636.640020:0:16256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.640037:0:16256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135636.640040:0:16256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783135636.640047:0:16256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.640059:0:16256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.675776:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783135636.741931:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:3.0:1783135636.741949:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:1.0:1783135636.742547:0:14765:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 6291456 00002000:00010000:1.0:1783135636.742552:0:14765:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1783135635 -> 1783135636 00002000:00010000:1.0:1783135636.742555:0:14765:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1783135635 -> 1783135636 00002000:00010000:1.0:1783135636.742557:0:14765:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:1.0:1783135636.742573:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.742587:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.742612:0:14765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.742620:0:14765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c38400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135636.742625:0:14765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.742634:0:14765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.742655:0:14765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.742663:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000faaa267c/0xf646e0cda875df85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.743015:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ceb6e8e3-b75e-4201-a568-34429b542814+21:2361:x1869752792380928:12345-192.168.201.60@tcp:4:dd.0 Request processed in 140875us (141274us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1783135636.743030:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 0 00000100:00100000:1.0:1783135636.743068:0:14765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 4 00000100:00100000:1.0:1783135636.743080:0:14765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ceb6e8e3-b75e-4201-a568-34429b542814+20:2360:x1869752792381824:12345-192.168.201.60@tcp:4:dd.0 00010000:00010000:1.0:1783135636.743113:0:14765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.743125:0:14765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135636.743135:0:14765:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135636.743142:0:14765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.743155:0:14765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783135636.799461:0:16254:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:1.0:1783135636.799481:0:16254:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:1.0:1783135636.799498:0:16254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.799512:0:16254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.799521:0:16254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.799530:0:16254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b3c00 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135636.799535:0:16254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.799544:0:16254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.799569:0:16254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.799605:0:16254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c6b1538/0xf646e0cda875df8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.799742:0:16254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ceb6e8e3-b75e-4201-a568-34429b542814+22:2361:x1869752792381056:12345-192.168.201.60@tcp:4:dd.0 Request processed in 187154us (189168us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1783135636.799754:0:16254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 1 00000100:00100000:1.0:1783135636.799789:0:16254:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 5 00000100:00100000:1.0:1783135636.799802:0:16254:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ceb6e8e3-b75e-4201-a568-34429b542814+21:2361:x1869752792381184:12345-192.168.201.60@tcp:4:dd.0 00010000:00010000:1.0:1783135636.799908:0:16254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.799921:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135636.799925:0:16254:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783135636.799932:0:16254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.799943:0:16254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783135636.800462:0:16255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:3.0:1783135636.800474:0:16255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800484:0:16255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800491:0:16255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800497:0:16255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3d043400 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135636.800502:0:16255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800509:0:16255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800534:0:16255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800542:0:16255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059168199/0xf646e0cda875df93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.800583:0:16255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ceb6e8e3-b75e-4201-a568-34429b542814+21:2360:x1869752792381312:12345-192.168.201.60@tcp:4:dd.0 Request processed in 168939us (189946us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1783135636.800601:0:16255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 2 00000100:00100000:3.0:1783135636.800623:0:16255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 6 00000100:00100000:3.0:1783135636.800631:0:16255:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ceb6e8e3-b75e-4201-a568-34429b542814+20:2361:x1869752792381696:12345-192.168.201.60@tcp:4:dd.0 00010000:00010000:3.0:1783135636.800649:0:16255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800659:0:16255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135636.800662:0:16255:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135636.800667:0:16255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800678:0:16255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800898:0:16256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800918:0:16256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800927:0:16256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800933:0:16256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f123b2600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135636.800936:0:16256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800943:0:16256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800954:0:16256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.800963:0:16256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a83cfcc9/0xf646e0cda875df9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.800997:0:16256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ceb6e8e3-b75e-4201-a568-34429b542814+20:2360:x1869752792381568:12345-192.168.201.60@tcp:4:dd.0 Request processed in 161029us (190324us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1783135636.801004:0:16256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 3 00000100:00100000:3.0:1783135636.801019:0:16256:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:3.0:1783135636.801027:0:16256:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ceb6e8e3-b75e-4201-a568-34429b542814+19:2361:x1869752792381440:12345-192.168.201.60@tcp:4:dd.0 00010000:00010000:3.0:1783135636.801043:0:16256:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.801057:0:16256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135636.801060:0:16256:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783135636.801065:0:16256:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.801074:0:16256:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783135636.809743:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1783135636.809775:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:0.0:1783135636.861105:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:1.0:1783135636.862240:0:14765:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 12295 00010000:00010000:1.0:1783135636.862263:0:14765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.862277:0:14765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.862300:0:14765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.862306:0:14765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c487000 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:1.0:1783135636.862312:0:14765:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.862321:0:14765:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.862344:0:14765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783135636.862351:0:14765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c60cd933/0xf646e0cda875dfa1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783135636.862425:0:14765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ceb6e8e3-b75e-4201-a568-34429b542814+17:2360:x1869752792381824:12345-192.168.201.60@tcp:4:dd.0 Request processed in 119346us (251718us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1783135636.862432:0:14765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 4 00002000:00010000:3.0:1783135636.913968:0:16255:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:3.0:1783135636.913994:0:16255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.914008:0:16255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.914017:0:16255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.914024:0:16255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39200 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135636.914029:0:16255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.914038:0:16255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.914059:0:16255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.914084:0:16255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2e9b387/0xf646e0cda875dfaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.914360:0:16255:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:ceb6e8e3-b75e-4201-a568-34429b542814+15:2361:x1869752792381696:12345-192.168.201.60@tcp:4:dd.0 Request processed in 113725us (293954us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1783135636.914371:0:16255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 6 00000001:00080000:3.0:1783135636.914412:0:6616:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1783135636.915420:0:16254:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.915435:0:16254:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.915443:0:16254:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.915450:0:16254:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f3c486600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:3.0:1783135636.915456:0:16254:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.915465:0:16254:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.915482:0:16254:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783135636.915508:0:16254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000090ea6c56/0xf646e0cda875dfa8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783135636.915577:0:16254:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:ceb6e8e3-b75e-4201-a568-34429b542814+7:2361:x1869752792381184:12345-192.168.201.60@tcp:4:dd.0 Request processed in 115777us (295343us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1783135636.915586:0:16254:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 5 00010000:00010000:2.0:1783135636.916595:0:16256:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.916610:0:16256:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.916632:0:16256:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.916639:0:16256:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8e8f02c39600 already unused, calling callback (ffffffffc16e5ce0) 00010000:00010000:2.0:1783135636.916644:0:16256:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.916652:0:16256:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.916679:0:16256:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783135636.917296:0:16256:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45b8547/0xf646e0cda875dfb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16256 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783135636.917439:0:16256:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05733480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:ceb6e8e3-b75e-4201-a568-34429b542814+5:2361:x1869752792381440:12345-192.168.201.60@tcp:4:dd.0 Request processed in 116407us (297150us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1783135636.917450:0:16256:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 7 00000100:00100000:1.0:1783135637.114204:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813334272:0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.114280:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135637.114339:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813334784:0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.114372:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135637.114399:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783135637.114405:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813334400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.114444:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135637.114498:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813334272 00000100:00100000:1.0:1783135637.114510:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813334272 00000100:00100000:1.0:1783135637.114553:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813334400 00000100:00100000:1.0:1783135637.114557:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813334400 00000100:00100000:1.0:1783135637.114590:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135637.114598:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f05731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813334272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.114666:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f05731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813334272:12345-0@lo:400:kworker.0 Request processed in 56us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135637.114674:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1783135637.114699:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135637.114706:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813334400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.114735:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869752813334400:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135637.114741:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783135637.114760:0:14124:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813334784 00000100:00100000:1.0:1783135637.114763:0:14124:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813334784 00000100:00100000:1.0:1783135637.114791:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783135637.114798:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8e03331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813334784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.114888:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8e03331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869752813334784:12345-0@lo:400:kworker.0 Request processed in 91us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135637.114895:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1783135637.114916:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783135637.114922:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783135637.114963:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813334400:0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.114973:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1783135637.114979:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8e8f3db05c00, transno 8589934595 00000004:00080000:1.0:1783135637.114998:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1783135637.115020:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3313:1869752813334272:0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.115033:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3313:1869752813334784:0@lo:400:kworker.0 00000100:00100000:3.0:1783135637.115786:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813334528:0@lo:400:kworker.0 00000100:00100000:3.0:1783135637.115881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135637.115908:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783135637.115915:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3311:1869752813334144:0@lo:400:kworker.0 00000100:00100000:3.0:1783135637.115944:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135637.115973:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f05732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813334656:0@lo:400:kworker.0 00000100:00100000:3.0:1783135637.115996:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783135637.116022:0:14116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813334144 00000100:00100000:3.0:1783135637.116026:0:14116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813334144 00000100:00100000:3.0:1783135637.116061:0:14116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783135637.116069:0:14116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3311:x1869752813334144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783135637.116107:0:14116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6+19:3311:x1869752813334144:12345-0@lo:400:kworker.0 Request processed in 39us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1783135637.116126:0:14116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1783135637.116167:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05730700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9769ae29-b6ca-42fe-978a-c41f2bd6dcc6:3311:1869752813334144:0@lo:400:kworker.0 00000100:00100000:1.0:1783135637.116573:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813334528 00000100:00100000:1.0:1783135637.116580:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813334528 00000100:00100000:1.0:1783135637.117175:0:14125:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813334656 00000100:00100000:1.0:1783135637.117180:0:14125:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813334656 00000100:00080000:3.0:1783135637.117238:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783135637.129232:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135637.129260:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813334528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135637.129369:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869752813334528:12345-0@lo:400:kworker.0 Request processed in 122us (13487us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135637.129377:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783135637.129404:0:14124:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135637.129425:0:14124:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3db06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813334656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783135637.129456:0:14124:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3db06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869752813334656:12345-0@lo:400:kworker.0 Request processed in 31us (13458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135637.129461:0:14124:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783135637.129586:0:3314:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f1063f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813334912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783135637.129642:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783135637.129852:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813334912 00000100:00100000:2.0:1783135637.129859:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813334912 00000100:00100000:2.0:1783135637.129896:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135637.129903:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813334912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783135637.129935:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783135637.129972:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c62300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3314:x1869752813334912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1783135637.129979:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783135637.130088:0:3314:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f1063f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3314:1869752813334912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783135637.130385:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05732300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3311:1869752813334656:0@lo:400:kworker.0 00000100:00100000:3.0:1783135637.130412:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f05731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869752813334528:0@lo:400:kworker.0 00010000:00010000:1.0:1783135637.692473:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783135638.138123:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff8e8f3db5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813335040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783135638.138253:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783135638.138457:0:14763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752813335040 00000100:00100000:1.0:1783135638.138467:0:14763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752813335040 00000100:00100000:1.0:1783135638.138551:0:14763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783135638.138564:0:14763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f02c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813335040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783135638.138598:0:14763:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1783135638.138662:0:14763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f02c60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869752813335040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1783135638.138670:0:14763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783135638.138737:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff8e8f3db5b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3311:1869752813335040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783135638.138922:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783135638.520737:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135638.520785:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135638.520850:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135638.520882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135638.520904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135638.520925:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135638.520949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.60@tcp (source: 12345-192.168.201.60@tcp) 00000100:00100000:0.0:1783135638.520982:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792382336 00000100:00100000:0.0:1783135638.520994:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792382336 00000100:00100000:0.0:1783135638.521059:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792382592 00000100:00100000:0.0:1783135638.521063:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792382592 00000100:00100000:0.0:1783135638.521081:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792382208 00000100:00100000:0.0:1783135638.521083:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792382208 00000100:00100000:0.0:1783135638.521093:0:14760:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792382720 00000100:00100000:0.0:1783135638.521095:0:14760:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792382720 00000100:00100000:0.0:1783135638.521110:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:0.0:1783135638.521123:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792382336:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135638.521228:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792382336:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 107us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135638.521236:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 19 00000100:00100000:0.0:1783135638.521255:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:0.0:1783135638.521261:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792382592:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135638.521286:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792382592:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135638.521291:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 20 00000100:00100000:0.0:1783135638.521300:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:0.0:1783135638.521319:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792382208:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135638.521344:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ceb6e8e3-b75e-4201-a568-34429b542814+5:2360:x1869752792382208:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 26us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135638.521351:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 21 00000100:00100000:0.0:1783135638.521361:0:14760:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:0.0:1783135638.521367:0:14760:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792382720:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135638.521401:0:14760:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+5:2360:x1869752792382720:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 21us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135638.521408:0:14760:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 22 00000100:00100000:0.0:1783135638.521606:0:14117:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792381952 00000100:00100000:0.0:1783135638.521611:0:14117:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792381952 00000100:00100000:0.0:1783135638.521650:0:14117:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 121 00000100:00100000:0.0:1783135638.521658:0:14117:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f3fd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:2360:x1869752792381952:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135638.521683:0:14117:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f3fd28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6f021332-5796-4bf3-99ee-d085123cca02+13:2360:x1869752792381952:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 26us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135638.521689:0:14117:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 121 00000100:00100000:0.0:1783135638.521727:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792382080 00000100:00100000:0.0:1783135638.521731:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792382080 00000100:00100000:0.0:1783135638.521761:0:14123:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1869752792382464 00000100:00100000:0.0:1783135638.521763:0:14123:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1869752792382464 00000100:00100000:0.0:1783135638.521783:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:0.0:1783135638.521800:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+20:2360:x1869752792382080:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135638.521862:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ceb6e8e3-b75e-4201-a568-34429b542814+20:2360:x1869752792382080:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 73us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135638.521869:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 28 00000100:00100000:0.0:1783135638.521890:0:14123:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00100000:0.0:1783135638.521895:0:14123:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8e8f1063d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2360:x1869752792382464:12345-192.168.201.60@tcp:400:kworker.0 00000100:00100000:0.0:1783135638.521920:0:14123:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8e8f1063d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a2ce35c1-9280-4944-a51c-87d3518837f6+6:2360:x1869752792382464:12345-192.168.201.60@tcp:400:kworker.0 Request processed in 25us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1783135638.521925:0:14123:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.60@tcp, seq: 29 00000100:00080000:0.0:1783135638.521946:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783135638.521951:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783135638.521953:0:14119:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783135638.714113:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783135638.811324:0:16296:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1783135639.738158:0:14112:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783135640.764544:0:14111:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29684 lines, 29684 kept, 0 dropped, 0 bad.